-- Logs begin at Sat 2022-10-22 23:29:14 UTC, end at Sun 2022-10-23 00:23:11 UTC. -- Oct 22 23:54:21.400360 dv-cinder-861566-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 22 23:54:21.409415 dv-cinder-861566-5-smb devstack@keystone.service[81341]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 23:54:21 2022] *** Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: nodename: dv-cinder-861566-5-smb Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: machine: x86_64 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: clock source: unix Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: pcre jit disabled Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: detected number of CPU cores: 4 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: current working directory: / Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: detected binary path: /usr/bin/uwsgi-core Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: your processes number limit is 47680 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: your memory page size is 4096 bytes Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: detected max file descriptor number: 2048 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: lock engine: pthread robust mutexes Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: thunder lock: enabled Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 22 23:54:21.412273 dv-cinder-861566-5-smb devstack@keystone.service[81341]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 23:54:21.451140 dv-cinder-861566-5-smb devstack@keystone.service[81341]: Python main interpreter initialized at 0x555d17b089c0 Oct 22 23:54:21.451140 dv-cinder-861566-5-smb devstack@keystone.service[81341]: python threads support enabled Oct 22 23:54:21.451140 dv-cinder-861566-5-smb devstack@keystone.service[81341]: your server socket listen backlog is limited to 100 connections Oct 22 23:54:21.451140 dv-cinder-861566-5-smb devstack@keystone.service[81341]: your mercy for graceful operations on workers is 90 seconds Oct 22 23:54:21.451487 dv-cinder-861566-5-smb devstack@keystone.service[81341]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 23:54:21.451575 dv-cinder-861566-5-smb devstack@keystone.service[81341]: *** Operational MODE: preforking *** Oct 22 23:54:21.451822 dv-cinder-861566-5-smb devstack@keystone.service[81341]: *** uWSGI is running in multiple interpreter mode *** Oct 22 23:54:21.451822 dv-cinder-861566-5-smb devstack@keystone.service[81341]: spawned uWSGI master process (pid: 81341) Oct 22 23:54:21.452027 dv-cinder-861566-5-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 22 23:54:21.459098 dv-cinder-861566-5-smb devstack@keystone.service[81341]: spawned uWSGI worker 1 (pid: 81355, cores: 1) Oct 22 23:54:21.459098 dv-cinder-861566-5-smb devstack@keystone.service[81341]: spawned uWSGI worker 2 (pid: 81356, cores: 1) Oct 22 23:54:21.459098 dv-cinder-861566-5-smb devstack@keystone.service[81341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 23:54:25.730241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:54:25.730241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: from cryptography.utils import int_from_bytes Oct 22 23:54:25.731018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:54:25.731018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: from cryptography.utils import int_from_bytes Oct 22 23:54:25.732149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:54:25.732149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: from cryptography.utils import int_from_bytes Oct 22 23:54:25.732606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 23:54:25.732606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: from cryptography.utils import int_from_bytes Oct 22 23:54:25.780099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 23:54:25.780228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 23:54:25.780405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] command line args: [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 23:54:25.780673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 23:54:25.780848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ================================================================================ {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 23:54:25.781098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] admin_token = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.781341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] config_dir = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.781525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.781708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] config_source = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.781877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 23:54:25.781962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] debug = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.782070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.782330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 23:54:25.782330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] command line args: [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 23:54:25.782453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.782511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 23:54:25.782655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.782744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ================================================================================ {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 23:54:25.782846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.782923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] admin_token = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] config_dir = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_config_append = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] config_source = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] debug = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_dir = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.783937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_file = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.784875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_config_append = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_dir = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_file = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.785848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.786930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.787966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] publish_errors = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.788971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] standard_threads = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.789998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] publish_errors = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] use_journal = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] use_json = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] use_stderr = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] use_syslog = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.790959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.791119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.791254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.791360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] standard_threads = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.791444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.791596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.791703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.791842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.791929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.792006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.792175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.792258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] use_journal = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.792349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] use_json = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.792425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.792510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] use_stderr = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.792647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.792723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] use_syslog = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.792881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.792962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 23:54:25.793126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.793936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.794891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.795956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.796864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.797949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.798976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.799890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.800477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.800646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.800722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.800884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.800962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.801913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.802856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.803960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.804998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.805940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.806899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.807998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.808956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.809973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.810924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.811894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.812831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.813946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.814941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.815104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.815185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.815341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.815429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.815617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.816953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.817910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.external = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.818894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.password = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] auth.token = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.819838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.external = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.820957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.password = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] auth.token = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.821993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.822963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.823954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824201 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.824935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.825891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.826848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.827860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828486 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.828952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.829985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.830913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.831937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.832889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.833970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834680 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.834923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.835970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.836903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.837899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.838997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.839924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.840897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.841874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.842966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.843950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.844972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.845915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846081 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.846910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.847881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.848866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.849987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.850960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] role.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.851944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] role.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.852989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] role.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.853940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] role.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.854890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.855948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.856931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.857983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.858921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.859904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.860847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.861961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.862037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.862199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.862274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.862962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.863949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.864932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.connection = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.865971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.866910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.connection = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.867884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.868980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 23:54:25.869701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.869917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.870168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.870408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.870654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.870888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.871158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.871401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 23:54:25.871573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 23:54:25.898946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.899198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.899427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.900082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.900317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.900549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.907642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.908789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.937147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.937264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.937378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.937460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.989474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:25.989777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.038970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.039175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.039540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.039775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.192999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.193222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.193444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.193664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.193881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.194094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.194248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.194483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.194708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.194930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.195177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.195396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.217984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.218983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.229639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.229961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.242276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.242505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.242685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.242783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.242924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81355) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.243802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.244015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 23:54:26.260877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.261086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 23:54:26.261167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.261370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 23:54:26.261450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.261614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 23:54:26.261719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.261888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.261969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 23:54:26.262149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.262991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.272343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.272620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.272702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.272890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.272971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.273173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.273263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.273478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.280143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.280486 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.283025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.283338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.283419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.283623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.283704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.283908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.283996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.284192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.284781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.284989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.285923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.286124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.286206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.286404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.286482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.286679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.309733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.310085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.311174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.311461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.311585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.311874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.316593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.316885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.317173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.317750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.318034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.318317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.323605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.323900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.324791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.325078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.329229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.329520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.329601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.329812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.329892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.330942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.331023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.331763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.331850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.332044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.347804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.348083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.348310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.348594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.352002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.352477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.355337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.355638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.355743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.356045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.359847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.360281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.363038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.363496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.366267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.366552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.366698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.366838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.367902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.368212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.383431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.383720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.383987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.384110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.384233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.384365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.384590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.384862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.391041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.391747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.392605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.393293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.394676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.395044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.395384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.395676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.397711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.397998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.398386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.398521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.398670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.398795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.398957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.399100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.399283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.399673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.410558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.410843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.411244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.411436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.411573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.411734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.411859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.412024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.412149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.412315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.412439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.412723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.413013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.413308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.427924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.429009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.430803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.431974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.433772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.434867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.435252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.436354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.436860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.437154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.437434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.437845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.438135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.438543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.443803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.444972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.445277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.446463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.448306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.448600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.448885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.449161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.449370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.449772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.450064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.450350 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.457560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.457851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.458133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.458749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.459044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.459360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.465841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81355) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.466127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.466265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 23:54:26.466409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.466547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.466683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.466833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.466956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.467988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.468853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81355) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.469944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 23:54:26.502739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d17b089c0 pid: 81355 (default app) Oct 22 23:54:26.504448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d17b089c0 pid: 81356 (default app) Oct 22 23:54:26.506028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d22b5-1c25-4bd8-9b80-f2fec9734e4b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:26.506312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d22b5-1c25-4bd8-9b80-f2fec9734e4b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:26.506582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d22b5-1c25-4bd8-9b80-f2fec9734e4b None None] PATH_INFO: `/v3` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:26.510708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sat Oct 22 23:54:26 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:33.231401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:33.231900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:33.232002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:33.236257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:54:33.243258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:33.243799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:33.243799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:33.312958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: INFO dbcounter [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] Registered counter for database keystone Oct 22 23:54:33.332219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG oslo_db.sqlalchemy.engines [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:54:33.338402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writer thread running {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:54:33.517768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG passlib.handlers.bcrypt [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81355) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 22 23:54:33.518070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG passlib.handlers.bcrypt [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81355) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 22 23:54:33.576713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:33.578338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:33.705544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 22 23:54:34.178871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:34.247646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: INFO dbcounter [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] Registered counter for database keystone Oct 22 23:54:34.268420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 23:54:34.274592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writer thread running {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 23:54:34.390314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ba222-a92e-4de6-a54b-b17c98f76f3c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:34.394551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:34.395198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:34.395477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:34.395746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:34.403814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:34.455688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING keystone.common.rbac_enforcer.enforcer [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 22 23:54:34.455971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f6161-1285-4320-bd85-c988b9ad709e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:34.465365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Oct 22 23:54:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 22 23:54:34.471383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:34.489125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d403b71-bd69-463a-b3ad-91738db3b094 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:34.493590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:34.494690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:34.494971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:34.495276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] PATH_INFO: `/v3/projects/c3ab34f677c3438798ed2f88102aad11` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:34.499023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] RBAC: Authorizing `identity:get_project(project_id=c3ab34f677c3438798ed2f88102aad11)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:34.549212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 22 23:54:34.549559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0042340-c38c-4c6d-a829-f93d0f5d60fb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:34.554994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:54:34 2022] GET /identity/v3/projects/c3ab34f677c3438798ed2f88102aad11 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:36.651378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd865-bc3b-451f-9189-ff005b1165a8 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:36.651881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd865-bc3b-451f-9189-ff005b1165a8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:36.651961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd865-bc3b-451f-9189-ff005b1165a8 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:36.656003 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:54:36.661905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:36.662269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:36.662450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:36.683002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:36.684530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:36.692216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 23:54:36.954539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd865-bc3b-451f-9189-ff005b1165a8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:36.967225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd865-bc3b-451f-9189-ff005b1165a8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:36.971496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:36.972695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:36.972973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:36.973245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:36.980811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:36.982576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc18a61-a1a3-4bf6-9c88-64f127499146 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:36.991222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Oct 22 23:54:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 22 23:54:36.996207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:37.005127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f280c-cc2a-4810-b979-a0a1f0e02c3c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:37.009401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:37.010019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:37.010296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:37.010568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] PATH_INFO: `/v3/users/b9d16ca4ea714ae1a819840d96e40696` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:37.011872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9d16ca4ea714ae1a819840d96e40696)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:37.013659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b1c58-e122-45af-b166-3fabda4f34b1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:37.015165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sat Oct 22 23:54:36 2022] GET /identity/v3/users/b9d16ca4ea714ae1a819840d96e40696 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:39.177662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fcc1-dc1d-4569-ac8f-6cbcabd98f99 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.178217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fcc1-dc1d-4569-ac8f-6cbcabd98f99 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.178217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fcc1-dc1d-4569-ac8f-6cbcabd98f99 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.179540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:39.184576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.184989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.185168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.203568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:39.204745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:39.249316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eccf-fe6a-4098-a452-d1dec328ad8e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.249598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eccf-fe6a-4098-a452-d1dec328ad8e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.249879 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eccf-fe6a-4098-a452-d1dec328ad8e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.251226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:54:39.257182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.257464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.257735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.288123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:54:39.298474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG passlib.handlers.bcrypt [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81356) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 22 23:54:39.298855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG passlib.handlers.bcrypt [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81356) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 22 23:54:39.348286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:39.349851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:39.447312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:54:39.556707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:39.581338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:39.661271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a18e02-5142-4ccf-b9c3-53c982e797ac None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:39.694871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:39.695551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.695829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.696105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.707040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:39.712112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:39.716174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:39.717222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:54:39.720087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:39.723479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:39.804673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:39.814523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf829-440c-42a5-aac7-72c85eeb27f9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:39.816864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:39.825469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b063-3e3d-4c5b-914a-776357738a25 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:39.853886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:39.854751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.855032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.855338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.856310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:39.857744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:39.858767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:39.859412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:39.859696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:39.859971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:39.860638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:39.860940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:39.862336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:39.868782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.sql.core [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:54:39.868782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:54:39.868782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [parameters: {'id': '5f8ecbfae4714d31a9082ea312de33ef', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 23:54:39.868782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 23:54:39.874176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:54:39.879796 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:54:39.887135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 23:54:39.887939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application yield resource Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise self.value Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application session.commit() Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 23:54:39.888867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.flush() Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application compat.raise_( Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 23:54:39.889702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 23:54:39.890603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:54:39.891414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [parameters: {'id': '5f8ecbfae4714d31a9082ea312de33ef', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 23:54:39.892200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:39.893027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:39.894530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 8/16] 10.222.0.20 () {60 vars in 1137 bytes} [Sat Oct 22 23:54:39 2022] POST /identity/v3/domains => generated 190 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:54:39.895792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:39.983287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815b70-3b36-4a0a-b20e-819240bda267 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:39.993647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5637e-d1c7-4084-a035-5172df03cf3b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:40.016943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:40.017579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:40.017862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:40.018143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] PATH_INFO: `/v3/users/b9d16ca4ea714ae1a819840d96e40696` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:40.019399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] RBAC: Authorizing `identity:get_user(user_id=b9d16ca4ea714ae1a819840d96e40696)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:40.020861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:40.022412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:39 2022] GET /identity/v3/users/b9d16ca4ea714ae1a819840d96e40696 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:54:40.026996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:40.027664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:40.027834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:40.027938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:40.028216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:40.041901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:40.046282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:40.047874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:54:40.064645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:40.066091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:54:40.066892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:54:40.066892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:54:40.066892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:40.066892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:40.072139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:40.094222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:40.130592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ed5b5-d2da-49f8-8742-9552f8c5ee6d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:40.165213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:40.165846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:40.166129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:40.166407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:40.167583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:40.169008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:40.170837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:54:40.172870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a58b0-6f0d-464e-82f8-48dba9af2449 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:40.176623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:40.209269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:40.209871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:40.210148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:40.210426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:40.211046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:40.211378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:40.212742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ddd98-646a-4c6c-9cfc-e0f0aebbd14a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:40.229749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:54:40.258806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:40.278888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ee0ee-9002-4225-8610-4ca3dfb6bcda None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:40.315739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:40.316420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:40.316694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:40.316963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] PATH_INFO: `/v3/domains/default/users/b9d16ca4ea714ae1a819840d96e40696/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:40.319039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b9d16ca4ea714ae1a819840d96e40696, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:40.320527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d77d4-50f0-47de-b54d-29973a961174 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:40.434926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1361 bytes} [Sat Oct 22 23:54:40 2022] PUT /identity/v3/domains/default/users/b9d16ca4ea714ae1a819840d96e40696/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:54:42.807475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9205-36a8-4bdc-99ef-652c0d2fd402 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:42.807944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9205-36a8-4bdc-99ef-652c0d2fd402 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:42.807944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec9205-36a8-4bdc-99ef-652c0d2fd402 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:42.809574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:42.828416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac40c9-1f1f-493b-93a2-1280b06f9bd6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:42.828923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac40c9-1f1f-493b-93a2-1280b06f9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:42.828997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac40c9-1f1f-493b-93a2-1280b06f9bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:42.852103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f9ac40c9-1f1f-493b-93a2-1280b06f9bd6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:42.853620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f9ac40c9-1f1f-493b-93a2-1280b06f9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:42.948278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:43.129168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5974-620f-4f4e-92ab-f5c62c2251fa None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.129447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5974-620f-4f4e-92ab-f5c62c2251fa None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.129840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5974-620f-4f4e-92ab-f5c62c2251fa None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.131336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:43.137257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.137551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.137833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.161430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d8d4-9b84-47c0-9b9a-21a90e5149b6 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.161735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d8d4-9b84-47c0-9b9a-21a90e5149b6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.161978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d8d4-9b84-47c0-9b9a-21a90e5149b6 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.163360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:43.163635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:43.164782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:43.169095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.169377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.169654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.200254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:43.201502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:43.267506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:43.277403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:43.334158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:43.485458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:43.583572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:43.604821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:43.624747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104cda1-4f26-4ffd-bb51-f48d97e28ec0 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:43.663935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:43.664578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.665049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.665321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.688348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:43.690025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-c9ec4d3d-0be1-4bc9-844a-245327f3c39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:54:43.716253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:43.717165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:54:43.717953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:54:43.717953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:54:43.717953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:54:43.717953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:43.718603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824957-d3a2-4620-bb5b-36e60e8f22df None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.720259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824957-d3a2-4620-bb5b-36e60e8f22df None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.720259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824957-d3a2-4620-bb5b-36e60e8f22df None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.732067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:43.732869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824957-d3a2-4620-bb5b-36e60e8f22df None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:43.782482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfba9ce-925c-4b69-b285-5ad8766962c8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:43.800237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:43.826395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:43.827169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.827709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.828137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.841926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-aaa6c3a6-7d67-43f2-a784-6fbc38387bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:43.849959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:43.850958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:43.851846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:43.854652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:43.856028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.856430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.856818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.862130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824957-d3a2-4620-bb5b-36e60e8f22df None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:43.878805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:43.880981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:43.905026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:43.905703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:43.906037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:43.906316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:43.906961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:43.907292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:43.909753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:43.932260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:43.933324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:43.965312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:43.978351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:43.978965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.074589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64be95-a0a0-4d70-b476-4710b24cb7fb None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.091682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:44.107113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ad7d1-bc37-43f6-9944-e90ce002d081 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.120582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.121482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.121763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.122038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.122969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.125094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.147883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 17/33] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Oct 22 23:54:43 2022] POST /identity/v3/roles => generated 219 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:44.148727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.159935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.161579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.161907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.162190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.162886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:44.164617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.168849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0680f2c-20a2-436c-b7f5-ff3d6649dd97 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.197750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:44.200999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71f91-f904-436d-849c-c90afb8674c0 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.201317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71f91-f904-436d-849c-c90afb8674c0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.201550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71f91-f904-436d-849c-c90afb8674c0 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.203942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 18/35] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:44.205756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71f91-f904-436d-849c-c90afb8674c0 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.283932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:44.335956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71f91-f904-436d-849c-c90afb8674c0 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.370672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb3f0-1dd0-43ee-a135-6d0bd6c87b4b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.383664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.384315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.384893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.385168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] PATH_INFO: `/v3/users/b9d16ca4ea714ae1a819840d96e40696` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.386797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] RBAC: Authorizing `identity:get_user(user_id=b9d16ca4ea714ae1a819840d96e40696)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.388841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b7fd-d6f4-40b7-a9a2-8681206fe784 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.390794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:44 2022] GET /identity/v3/users/b9d16ca4ea714ae1a819840d96e40696 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:44.391738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.392016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.392286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.415325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:44.417132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:44.417238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.417855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.418162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.418530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.419286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.420940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.455193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:54:44 2022] POST /identity/v3/projects => generated 301 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:44.455193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.495477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:44.510229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:44.511565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.629062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:44.652049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d118e5b-2744-4411-a980-cd202d70fca4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.705848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5db7-4a41-489f-8366-bebec29b4952 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:44.708122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.709701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.709987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.710356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.711113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.712505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.736061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Oct 22 23:54:44 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:44.754296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:44.754957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.755270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.755595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.756834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:44.758353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b9a0d-ee3c-4571-ab04-1c37b1774ce5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:44.760132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 21/40] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:44.767206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.768665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca0ee-c3c4-4dd2-89b4-c04ce09baf77 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.768950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca0ee-c3c4-4dd2-89b4-c04ce09baf77 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.769230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca0ee-c3c4-4dd2-89b4-c04ce09baf77 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.770812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:54:44.776696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:44.776990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:44.777253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:44.799254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:44.800644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:44.891227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:54:44.891995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:44.967691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:44.996647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:45.018146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b24e7-a321-4797-8fa1-6c5c8e9e1582 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:45.029358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad0e27-1bae-484c-a660-8cf7058e47c9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:45.058900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:45.059586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:45.059869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:45.060150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:45.060878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.domain.id=default, user.id=b9d16ca4ea714ae1a819840d96e40696) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:45.061244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:45.062694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:45.065206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:45.066379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:45.066651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:45.066919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:45.067613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:45.069019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:45.070899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 20/43] 10.222.0.20 () {56 vars in 1322 bytes} [Sat Oct 22 23:54:44 2022] GET /identity/v3/role_assignments?user.id=b9d16ca4ea714ae1a819840d96e40696&scope.domain.id=default&role.id=55e94c99a5d74674bcc214e7a019295d => generated 530 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:45.172988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:45.193153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 24/44] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Oct 22 23:54:44 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:45.295397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35650a90-b5c1-41fd-8008-7a1354c5e3a5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:45.332978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:45.333627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:45.333908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:45.334185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:45.335395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:45.336879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0150-33c8-43ae-bd53-320c18770b0b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:45.338537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 21/45] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:54:45.344523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:45.445536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabf0a-b780-4c57-96cf-5bb43da6a6e3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:45.462360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:45.479643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:45.480251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:45.480530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:45.480804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:45.481458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:45.483010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a05830-05b0-4f90-be61-825f36d2f99a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:45.508729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:54:45 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:54:47.627306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e33e-99fc-4251-a076-d3197db32314 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:47.627799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e33e-99fc-4251-a076-d3197db32314 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:47.627879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e33e-99fc-4251-a076-d3197db32314 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:47.629258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 22/47] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:47.634637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:47.635049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:47.635238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:47.653679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:47.655243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:47.720343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:47.989212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e33e-99fc-4251-a076-d3197db32314 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:48.007914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:48.089137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e33e-99fc-4251-a076-d3197db32314 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:48.121239 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:48.121846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:48.122126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:48.122396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:48.123513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:48.124923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd37dc-2126-4d3a-aeec-2dcb7bf96431 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:48.126454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 23/49] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:48.132416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:48.225750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:48.228514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd46652-32d1-47ae-be0e-25769530a799 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:48.262562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:48.263123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:48.263405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:48.263676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:48.264318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:48.265742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd996eb-157f-42ba-9225-fc1bdf6188e1 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:48.289564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 27/50] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Oct 22 23:54:48 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:50.400587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92e1c4-3804-48b0-aa6c-6924cc198b30 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:50.401092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92e1c4-3804-48b0-aa6c-6924cc198b30 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:50.401178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92e1c4-3804-48b0-aa6c-6924cc198b30 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:50.402484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 24/51] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:50.407654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:50.408054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:50.408217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:50.426798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:50.428019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:50.491268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:50.761118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92e1c4-3804-48b0-aa6c-6924cc198b30 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:50.844925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:50.861772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92e1c4-3804-48b0-aa6c-6924cc198b30 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:50.894264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:50.894886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:50.895197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:50.895475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:50.896582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:50.898017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65ec7-a2d0-4642-95b3-72dc992a7c10 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:50.899690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:50.905021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:50.983962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:51.002873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5370b-670a-4ef5-bc3c-3776121c0edf None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:51.137896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:51.138484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:51.138765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:51.139036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:51.139711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:51.141135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f9ec8-3e98-4d3f-8467-aa62532a9125 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:51.168710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 29/54] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:54:50 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:54.327728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead0ae4-9445-49e2-a829-bd6ae2080b29 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.328296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead0ae4-9445-49e2-a829-bd6ae2080b29 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.328296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead0ae4-9445-49e2-a829-bd6ae2080b29 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.329809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 26/55] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:54.337742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb069-0245-4965-b365-f233a2efc559 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.338138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb069-0245-4965-b365-f233a2efc559 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.338322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb069-0245-4965-b365-f233a2efc559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.364087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5dfbb069-0245-4965-b365-f233a2efc559 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:54.365310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5dfbb069-0245-4965-b365-f233a2efc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:54.453546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 30/56] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:54.670529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26920f-1d71-4f54-9ce9-581220dbf0cd None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.671228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26920f-1d71-4f54-9ce9-581220dbf0cd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.671729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26920f-1d71-4f54-9ce9-581220dbf0cd None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.673564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 27/57] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:54.679475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.680027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.680523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.708040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:54.709571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:54.758221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2abd5-658f-4af8-91bd-c2db41d9b26b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.758861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2abd5-658f-4af8-91bd-c2db41d9b26b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.759362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2abd5-658f-4af8-91bd-c2db41d9b26b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.760968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:54.766509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca072-7a96-4ff3-8dee-2101df97f86c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.767057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca072-7a96-4ff3-8dee-2101df97f86c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.767551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca072-7a96-4ff3-8dee-2101df97f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.788463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ca6ca072-7a96-4ff3-8dee-2101df97f86c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:54.790141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ca6ca072-7a96-4ff3-8dee-2101df97f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:54.800414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:54.807129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:54.808162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:54.911493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:54:54.913124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996312c1-9982-438c-a0ae-cb699a35e86a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.913613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996312c1-9982-438c-a0ae-cb699a35e86a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.914107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996312c1-9982-438c-a0ae-cb699a35e86a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.920635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 30/61] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:54.933225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:54.933773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:54.934248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:54.962561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:54.965200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:54.982875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2629c-b690-433a-82e3-55582de8aabe None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.043697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.044705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.045203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.045682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.069475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:55.075098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:55.076009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:54:55.076783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:55.080422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 32/62] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:54:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:55.082632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.099264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:54:55.107187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.131507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.166700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.204380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7bfe-b3e2-4fc4-bce4-fc3879f057ec None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.248338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.248977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.249261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.249536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.250694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf0a9b-aaff-4e5a-8c6d-2a136e6df717 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.261065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-409c2775-a785-44a6-82a9-313fbe6f4195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:55.265962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:55.266769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 33/64] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:55.273296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc78c-5754-40fb-900b-b8e26fd909b3 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.273998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc78c-5754-40fb-900b-b8e26fd909b3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.273998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc78c-5754-40fb-900b-b8e26fd909b3 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.273998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 34/65] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:55.273998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc78c-5754-40fb-900b-b8e26fd909b3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.293761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.294378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.294654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.294924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.295933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:55.295933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.297259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.306271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 32/66] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.306959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.381529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc78c-5754-40fb-900b-b8e26fd909b3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.388909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.401248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.418261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799c81-d9ae-440f-bca0-c167920e7ce1 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.418516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.419176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.419452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.419725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.430346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-a3d7c743-7855-4d18-8355-24a9c1aa6714 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:55.435115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:55.436118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:55.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 35/67] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:55.437829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.437829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.437829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.455500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:55.457218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:55.457451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.458064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.458345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.458621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.459314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:55.459621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.460983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.468952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.469724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.527233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:55.528226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.583608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680246a-a74f-47f0-8224-cacf8123d2a8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.619706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.620340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.620620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.620893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.624435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.631566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab230-1c9b-4832-89dd-ae9328f2b544 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.638140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.639739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.641465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.646999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 34/70] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.646999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.670552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.671221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.671506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.671779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.683360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:54:55.688254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:54:55.689076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:54:55.689840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 37/71] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:54:55.690516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.760269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7daa-e6f8-4da5-a5dd-eebaed1a8637 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.797329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.797951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.798234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.798510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.799220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:55.800036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.801421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.802990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8330d-1032-490b-91fa-83bd2d7d5154 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.809711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.810503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.837386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.838010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.838285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.838557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] PATH_INFO: `/v3/users/b9d16ca4ea714ae1a819840d96e40696` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.839693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] RBAC: Authorizing `identity:get_user(user_id=b9d16ca4ea714ae1a819840d96e40696)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.841109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.842664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/users/b9d16ca4ea714ae1a819840d96e40696 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.843432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.869232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.877657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:55.912966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90280818-8cc3-443c-a6c4-720decc549da None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.941887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418173-6c65-4dd3-a6dc-c5fbf66990ab None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:55.946840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.947501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.947787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.948084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.949204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.950692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.954173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.954947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:55.981212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:55.981816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:55.982092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:55.982366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:55.983022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] RBAC: Adding query filter params (name=member) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:54:55.983424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:55.984773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:55.993262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 39/75] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:55.994117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.059378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7e0c-caf6-4710-9d94-37477043cfaa None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.081848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.091515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.093174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.093894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.094175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.094448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.095046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e62971-3ca0-43db-b551-bb24c1b4c18c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.095593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.097584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.099170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 37/76] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.099934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.133380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.134001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.134277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.134549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.135713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.137150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.138710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 40/77] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:55 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.139461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.201093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855888e0-d814-43e5-9902-4b605f9115e0 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.234272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.234903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.235229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.235316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1631-4e6b-4c94-bfef-4b5919ab9732 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.235509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.236658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.238638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.240300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 38/78] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:54:56 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.241060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.271575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.272231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.272516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.272792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.274821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, user_id=838fa254e7cd4455b3ba74c7bf9824ac, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.276282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.292040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 41/79] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:54:56 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:54:56.292819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.308382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.336117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.368910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c54f02-e4f8-4623-ae8e-4e4e97310c76 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.407348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.408194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.408399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.408683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.410554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.412044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.413755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 39/80] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:54:56 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.414554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.428476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb5605-9ef1-4945-afe3-840891b54f16 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.470423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.470840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.471227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.471793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.472500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.474287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.497069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 42/81] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:54:56 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:54:56.497876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.550332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf9a64-c3fb-4bde-9950-eb9a1036e1c2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.590015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.601318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.609396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.610327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.611460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.612499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.614276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.616702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.620142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 40/82] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:54:56 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.621191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.632044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380c02-3f94-4645-a5fb-a287f039c2ce None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.679337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.681002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.681468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.681919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/b9d16ca4ea714ae1a819840d96e40696/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.685477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, user_id=b9d16ca4ea714ae1a819840d96e40696, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.688068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.708211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:54:56 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/b9d16ca4ea714ae1a819840d96e40696/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:54:56.709852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.760380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941a97-55e5-484e-b2b7-7c25caf03317 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.811504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.812163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.812607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.812892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] PATH_INFO: `/v3/projects/181474f3545345ce97f66b6a4f4affbd` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.814678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] RBAC: Authorizing `identity:get_project(project_id=181474f3545345ce97f66b6a4f4affbd)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.817037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.820145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 41/84] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:54:56 2022] GET /identity/v3/projects/181474f3545345ce97f66b6a4f4affbd => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:54:56.827055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:54:56.856767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47ea4-7cf7-4713-9169-c57b726cfbb9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:56.903730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:56.904413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:56.904754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:56.905034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:56.913822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, user_id=838fa254e7cd4455b3ba74c7bf9824ac, role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:56.915554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b66b2-54f2-478f-9dc2-099e08eaa78a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:56.923156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:56.934966 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:54:56 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:54:56.974506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a01e-20da-473a-8cc4-6928e9718991 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:54:57.016611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:54:57.017302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:57.017581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:57.017855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] PATH_INFO: `/v3/projects/181474f3545345ce97f66b6a4f4affbd/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:57.020008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] RBAC: Authorizing `identity:create_grant(project_id=181474f3545345ce97f66b6a4f4affbd, user_id=838fa254e7cd4455b3ba74c7bf9824ac, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:54:57.021514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2319-130f-4fde-9c6e-042db6f3389d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:54:57.042756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:54:56 2022] PUT /identity/v3/projects/181474f3545345ce97f66b6a4f4affbd/users/838fa254e7cd4455b3ba74c7bf9824ac/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:54:59.538601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc526-5413-4b3b-b9f0-20798d5fc765 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.539141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc526-5413-4b3b-b9f0-20798d5fc765 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.539251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc526-5413-4b3b-b9f0-20798d5fc765 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.540522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 45/87] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:59.556307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528d83-abd8-49b7-856d-57b7fa763768 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.556800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528d83-abd8-49b7-856d-57b7fa763768 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.556872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528d83-abd8-49b7-856d-57b7fa763768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.585874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ef528d83-abd8-49b7-856d-57b7fa763768 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:59.587158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ef528d83-abd8-49b7-856d-57b7fa763768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:59.677578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 43/88] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:59.691342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639974-4f74-42e1-abec-bbb64d19f1d2 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.691631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639974-4f74-42e1-abec-bbb64d19f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.691908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639974-4f74-42e1-abec-bbb64d19f1d2 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.693498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 46/89] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:59.700208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aed32-9d3f-4d61-abb9-48a09cbbfbbd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.700711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aed32-9d3f-4d61-abb9-48a09cbbfbbd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.701214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aed32-9d3f-4d61-abb9-48a09cbbfbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.725162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4e9aed32-9d3f-4d61-abb9-48a09cbbfbbd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:59.726625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4e9aed32-9d3f-4d61-abb9-48a09cbbfbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:59.773709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fb3d-c3b4-4132-8fae-4800cbf17447 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.774299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fb3d-c3b4-4132-8fae-4800cbf17447 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.774826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fb3d-c3b4-4132-8fae-4800cbf17447 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.777428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 47/90] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:54:59.784998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c52d-fce0-47f2-b4c0-c9ef1e8c653f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:54:59.785526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c52d-fce0-47f2-b4c0-c9ef1e8c653f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:54:59.785989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c52d-fce0-47f2-b4c0-c9ef1e8c653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:54:59.794777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:59.809690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:54:59.824532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3c25c52d-fce0-47f2-b4c0-c9ef1e8c653f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:54:59.825744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3c25c52d-fce0-47f2-b4c0-c9ef1e8c653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:54:59.856409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 44/91] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:54:59.932621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 48/92] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:00.032827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91981-450c-4e6e-adcd-30ffec3e3eac None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.033113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91981-450c-4e6e-adcd-30ffec3e3eac None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.033308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91981-450c-4e6e-adcd-30ffec3e3eac None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.035507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 45/93] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:00.040527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.040818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.041098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.059986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91981-450c-4e6e-adcd-30ffec3e3eac None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.083718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:00.084953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:00.205085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 49/94] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:00.229214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.256973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91981-450c-4e6e-adcd-30ffec3e3eac None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.300106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.338192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6574f-4a9d-4666-bd3d-d2fb2a80bd23 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.356710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.357353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.357632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.357900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.378711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.379377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.379659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.379939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.380872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-fe6c8af7-a342-428a-b56e-776dc8ad3d9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:00.387208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:00.388220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:00.389160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:00.391795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:00.394257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86e64-de8a-43a9-b2d8-db8de1746b39 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.394691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86e64-de8a-43a9-b2d8-db8de1746b39 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.395107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86e64-de8a-43a9-b2d8-db8de1746b39 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.396547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 47/96] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:00.397383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86e64-de8a-43a9-b2d8-db8de1746b39 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.402802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:00.407758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:00.408594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:00.409429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:00.410039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.459117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.531758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86e64-de8a-43a9-b2d8-db8de1746b39 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.544837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5af8a-30d1-4f8f-b472-d78f9fae7ebb None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.571815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.575728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.576382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.576668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.576950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.584475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.585089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.585383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.585659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.586330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:00.586636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:00.588043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5ffe5-8aa6-4f50-a76d-756940d5c94e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:00.588814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:00.593928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:00.594747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:00.595573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:00.596825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 51/98] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:00.598007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.602719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.602719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.603025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 48/99] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:00.604028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.616380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:00.617574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:00.685854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 52/100] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:00.686904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.719669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168dd6-9b91-478a-932f-3d84616a12ab None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.722523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.755555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.756170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.756448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.756727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.757383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:00.757689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:00.759089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:00.767357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 49/101] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:00.767963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.792741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282758f2-f15d-4a55-a4bb-9dcc23eec724 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.807532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.829278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.830233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.830521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.831357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.832468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:00.833901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:00.835505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:00.836263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.873435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a136-2fb3-4541-a119-a2274cf8734f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.908392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.909062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.909346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.909621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.910279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:00.910582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:00.911990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906854f-f63e-417b-b666-a33c2a554e04 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 50/103] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599482-024e-420c-ba47-6a237706c182 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599482-024e-420c-ba47-6a237706c182 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599482-024e-420c-ba47-6a237706c182 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 51/104] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:00.920148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599482-024e-420c-ba47-6a237706c182 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:00.944398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537e4d-983e-42fb-ba25-aca9297d836b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:00.956930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:00.979819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:00.980452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:00.980735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:00.981013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] PATH_INFO: `/v3/users/0d8cfd9da6ef4ae29dbd48373c9f9884` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:00.996152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] RBAC: Authorizing `identity:get_user(user_id=0d8cfd9da6ef4ae29dbd48373c9f9884)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:00.997626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:00.999276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/users/0d8cfd9da6ef4ae29dbd48373c9f9884 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:01.000019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.033347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599482-024e-420c-ba47-6a237706c182 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.040561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.066878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.067540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.067825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.068106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] PATH_INFO: `/v3/users/b9d16ca4ea714ae1a819840d96e40696` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.069223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] RBAC: Authorizing `identity:get_user(user_id=b9d16ca4ea714ae1a819840d96e40696)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.070661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.072288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:00 2022] GET /identity/v3/users/b9d16ca4ea714ae1a819840d96e40696 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:01.073052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.099695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dca1d-9aaf-4412-880a-e45c39240c1f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.133605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.134206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.134491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.134770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.135446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.136870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c280f-3d58-4e7d-bddb-31126d75805b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.162850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 55/107] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:55:00 2022] POST /identity/v3/projects => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:01.164112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.164402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.164679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.177505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.184850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:01.185811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc02eb3-0e70-4732-b2fa-964b6ec0adc1 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.186112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:01.225919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.226581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.226910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.227149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.228315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.229923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.236280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 53/108] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:01.236280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.267047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:01.267047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.297901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.371501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d96985-fbde-49ff-89af-33c946877025 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.395239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2cfd3-f00e-41dd-9d0f-f7d5ca3a86cb None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.411673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.412412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.412696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.413206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.427438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:01.432622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:01.433493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:01.434260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:01.434883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.441735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.442376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.442659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.442933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.444092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.445535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.447553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:01.448228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.469913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.560780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.572426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a7b-9275-418f-a65c-d4f0d7577d26 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.576340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4bf9-1aed-4262-9c6f-1877e50cadc2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.609895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.610509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.610796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.611095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.614418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.615043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.615359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.615633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.683545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.684954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.687215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.714893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.785695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.800301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 55/112] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:01.800301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.803999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 58/113] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:01.804757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.903294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf862e2-0606-4096-9380-2d653db8b6f2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.909860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed86b-7c08-42dc-83dc-cf7724189365 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:01.926502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:01.941029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.941577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.941858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.942131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.942795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:01.943129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.944512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.945986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:01.946652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:01.946937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:01.947246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/0d8cfd9da6ef4ae29dbd48373c9f9884/roles/72e82c45f8d74e2eb6ebcffcb679331c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:01.949151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, user_id=0d8cfd9da6ef4ae29dbd48373c9f9884, role_id=72e82c45f8d74e2eb6ebcffcb679331c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:01.950585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:01.952827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 56/114] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:01.953628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:01.968954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:01 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/users/0d8cfd9da6ef4ae29dbd48373c9f9884/roles/72e82c45f8d74e2eb6ebcffcb679331c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:01.969780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.029821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.090073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018e9a-8cb4-4c8e-9e04-5af3dd8b9d16 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.113343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f5bf-36d6-467d-864d-ad8b2f00b3b0 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.131220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.131826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.132109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.132387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.133581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.135057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.136780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 60/116] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.137560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.166248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.166895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.167221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.167499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.178924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:02.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:02.185390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:02.186324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 57/117] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:02.186986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.236133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.271248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793e89-4566-42be-83b9-e8229b1196e5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.291472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.313332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55253-a9ac-4655-8a6b-c1280e5e7de4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.314033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.314678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.315106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.315396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.316623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.318058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.319950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 61/118] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.325422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.357310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.358184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.358590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.358864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.360404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.363112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.365678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 58/119] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.366549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.450246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158eec-0db1-484c-ab50-a0800ec11709 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.476521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a66a-f213-441a-8013-c99e4305eb5d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.492379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.499176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.500459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.501056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.501565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.503970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba, user.id=b9d16ca4ea714ae1a819840d96e40696) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:02.504782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.507163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.514596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.518073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.518073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.518073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.518073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:02.518073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.522434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.523874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 62/120] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/role_assignments?user.id=b9d16ca4ea714ae1a819840d96e40696&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.525448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.533972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 59/121] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.534729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.594384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.659017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67858ea-ee88-4f14-81df-026662e8b3ab None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.700659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.701628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.702154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.702637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.704294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] RBAC: Adding query filter params (role.id=38335e20ab1a4ff9976fcfd55484637f, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba, user.id=838fa254e7cd4455b3ba74c7bf9824ac) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:02.704831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.706607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.714446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 63/122] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/role_assignments?user.id=838fa254e7cd4455b3ba74c7bf9824ac&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.715911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.754074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a3d78-6e75-4f5e-a147-0e142ad8000f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.845361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.846058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.846872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.847206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.853038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ac5c-b6d2-4da7-aac1-b1a3cb5cc50f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:02.872290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.916001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:02.922085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:02.922743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:02.923111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:02.923469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] PATH_INFO: `/v3/users/838fa254e7cd4455b3ba74c7bf9824ac` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:02.925003 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] RBAC: Authorizing `identity:get_user(user_id=838fa254e7cd4455b3ba74c7bf9824ac)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.926493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:02.928427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 64/123] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/users/838fa254e7cd4455b3ba74c7bf9824ac => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:02.935225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:02.965089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:02.967843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.121265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f9b27-713d-4c31-8393-a396754886e2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:03.147374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 60/124] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:03.153333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:03.179904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:03.181107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.181861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.182338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.258333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:03.276558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:03.285956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:03.287585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.303224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1f203-ec73-4f12-aea0-d317f4186f08 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:03.358925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:03.360234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.361601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.362625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.364107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:03.365826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.367745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:03 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:03.375240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:03.446717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 65/126] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:03.455358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:03.498057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18904e97-cfd4-4029-8500-bb02966e2c23 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:03.542621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:03.543643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.544143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.544608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.545594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] RBAC: Adding query filter params (role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba, user.id=838fa254e7cd4455b3ba74c7bf9824ac) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:03.546096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:03.547757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98082eb-2205-40ef-8ba3-9e4928a0a529 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.556249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:03 2022] GET /identity/v3/role_assignments?user.id=838fa254e7cd4455b3ba74c7bf9824ac&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:03.557654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc18a6-e647-4734-9879-36b812782f72 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.558349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc18a6-e647-4734-9879-36b812782f72 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.558822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc18a6-e647-4734-9879-36b812782f72 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.560340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 63/128] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:03.566911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.567236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.567517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.586437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:03.587922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:03.590649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:03.592777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:03.630514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20806-dc7a-4d66-9817-0671726a9577 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:03.700404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:03.703242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.703787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.704301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] PATH_INFO: `/v3/projects/181474f3545345ce97f66b6a4f4affbd` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.704875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 64/129] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:03.706478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] RBAC: Authorizing `identity:get_project(project_id=181474f3545345ce97f66b6a4f4affbd)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:03.708165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.710359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 66/130] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:03 2022] GET /identity/v3/projects/181474f3545345ce97f66b6a4f4affbd => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:03.717551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:03.843899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee675ba-e00a-4020-bc01-18494a093697 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:03.878831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] RBAC: Adding query filter params (role.id=38335e20ab1a4ff9976fcfd55484637f, scope.project.id=181474f3545345ce97f66b6a4f4affbd, user.id=838fa254e7cd4455b3ba74c7bf9824ac) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:03.883795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:03.891015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 65/131] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:03 2022] GET /identity/v3/role_assignments?user.id=838fa254e7cd4455b3ba74c7bf9824ac&scope.project.id=181474f3545345ce97f66b6a4f4affbd&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:04.003466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:04.107310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed04035-b741-4373-b1b2-e1002e36db0d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:04.141416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:04.141989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:04.142272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:04.142548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:04.144191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:04.145619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7835e9-cf52-4a27-9245-3b2f7e63b7a6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:04.147199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 67/132] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:04.152740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:04.155671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:04.255457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafded9-b0ac-49bc-adcb-b721bd0ed635 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:04.288789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:04.289397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:04.289678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:04.289952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:04.290605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:04.292069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951c9c-5d64-43c3-8ede-ab77b60945bb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:04.318737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 66/133] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:04 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:04.349274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0cbc-a139-4556-ab11-f4137b009722 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:04.349586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0cbc-a139-4556-ab11-f4137b009722 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:04.349864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac0cbc-a139-4556-ab11-f4137b009722 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:04.351250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 68/134] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:04.357240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:04.357533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:04.357812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:04.377273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:04.379040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:04.435358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:04.451664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:04.717934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0cbc-a139-4556-ab11-f4137b009722 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:04.739778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:04.827423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac0cbc-a139-4556-ab11-f4137b009722 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:04.862449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:04.863097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:04.863392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:04.863670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:04.874392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:04.879456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:04.880296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:04.881732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 69/136] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:04.886395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:04.992382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86b849-3d18-47c0-93d0-ea9882de1358 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:05.027537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:05.028168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:05.028454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:05.028731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:05.029400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:05.029706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:05.031096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:05.041247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 68/137] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:05.046976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:05.132333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:05.154498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc34f-85d8-45ba-b626-b3e304e77a9a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:05.198650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:05.198650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:05.198650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:05.198650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] PATH_INFO: `/v3/users/0d8cfd9da6ef4ae29dbd48373c9f9884` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:05.199203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8cfd9da6ef4ae29dbd48373c9f9884)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:05.199203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:05.199203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 70/138] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:05 2022] GET /identity/v3/users/0d8cfd9da6ef4ae29dbd48373c9f9884 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:05.204082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:05.257434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:05.317402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bca8-6c3f-4116-a860-ac33a7d69e25 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:05.352466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:05.353316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:05.353734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:05.354173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:05.422286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:05.423998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:05.473105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:05.536403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:05.542643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:05.644461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158e84-e17f-44d6-8c7c-14febd89c0c9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:05.679000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:05.679713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:05.679998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:05.680277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:05.681450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:05.682894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a421-c6c7-43fb-9237-d989250245b3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:05.684619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 71/140] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:05 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:05.691082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:05.796155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8e2f-11f2-49b2-a5ec-be2d4317ed5e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:05.835661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:05.836571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:05.837083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:05.837568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:05.838470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] RBAC: Adding query filter params (role.id=72e82c45f8d74e2eb6ebcffcb679331c, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba, user.id=0d8cfd9da6ef4ae29dbd48373c9f9884) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:05.838950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:05.840603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6bf8d-8273-4fcb-b0b1-8bb92d250ce1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:05.847472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 70/141] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:05 2022] GET /identity/v3/role_assignments?user.id=0d8cfd9da6ef4ae29dbd48373c9f9884&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=72e82c45f8d74e2eb6ebcffcb679331c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:06.625042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173d3d3-d22b-4d38-acc2-422a724e5bd3 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.625531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173d3d3-d22b-4d38-acc2-422a724e5bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.625600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173d3d3-d22b-4d38-acc2-422a724e5bd3 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.627125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 72/142] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:06.632530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1576-a39e-40cd-b9fa-63958fa84871 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.632915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1576-a39e-40cd-b9fa-63958fa84871 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.633072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1576-a39e-40cd-b9fa-63958fa84871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.651631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-d97a1576-a39e-40cd-b9fa-63958fa84871 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:06.652820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d97a1576-a39e-40cd-b9fa-63958fa84871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:06.662094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:06.726923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 71/143] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:06.801992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650884ed-bfa8-434a-b573-c7fada5de797 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.802272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650884ed-bfa8-434a-b573-c7fada5de797 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.802469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650884ed-bfa8-434a-b573-c7fada5de797 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.803967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 73/144] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:06.808852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.809143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.809419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.828282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:06.829463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:06.858200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0635-a150-4652-a15f-7322f13f6055 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.858480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0635-a150-4652-a15f-7322f13f6055 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.858755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0635-a150-4652-a15f-7322f13f6055 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.860258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:06.865049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:06.865341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:06.865619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:06.883708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:06.884916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:06.895389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:06.902584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:06.957714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:06.998468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.074327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.101277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1bbe6-97b3-406a-bd2a-e2ad31168c07 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.133805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.134429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.134705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.134976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.145322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:07.150230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:07.151491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:07.152264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:07.157494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.189010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.257925 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e32978-a7b8-4209-a29f-b4157004898f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.289962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb89d2-6a0f-4207-b9ab-195fffc7a3e7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.291989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.292597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.292872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.293152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.293806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:07.294108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.295500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.303798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.304571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.312949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.331772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.332235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.332543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.332818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.335161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.345038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:07.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:07.350892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:07.351912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:07.353906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.408574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c47fd6-9a10-40f8-91db-4e9d06634da6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.441564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.442190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.442466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.442739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.443867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.445304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.446851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.451412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.454680 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8697-8164-4cb4-b5d8-90ba92494837 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.489931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.490571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.490843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.491144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] PATH_INFO: `/v3/users/da697c63336f42b3bdeff500840b8659` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.504853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] RBAC: Authorizing `identity:get_user(user_id=da697c63336f42b3bdeff500840b8659)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.506303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.508125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/users/da697c63336f42b3bdeff500840b8659 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.508704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.531021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.556347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3f75-0188-4928-a7e6-27ebfb85ccd0 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.563501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.597035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.597567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.597845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.598118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.598772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:07.599099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.600467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.608424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.609211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.617584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c937ff7-092d-4a10-90e9-1e8d822f583f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.658534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.659694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.659984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.660267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.660922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.662485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.686956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 76/154] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:07 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:07.687642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.738603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64174645-d553-40d9-a938-e084e070fa2d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.776888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.777603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.777881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.778159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.779454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.781839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.782814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 79/155] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.788788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.793028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.820010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c526-71e9-435b-8fa2-c77608cec408 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.831320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:07.870225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.871161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.871597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.871874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] PATH_INFO: `/v3/users/da697c63336f42b3bdeff500840b8659` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.873750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=da697c63336f42b3bdeff500840b8659)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.875325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.877018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 77/156] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/users/da697c63336f42b3bdeff500840b8659 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:07.883213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:07.932072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995002ec-2002-4775-beb9-231d99cec039 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:07.972535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:07.973235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:07.973519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:07.973796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/da697c63336f42b3bdeff500840b8659/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:07.976067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, user_id=da697c63336f42b3bdeff500840b8659, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:07.977575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:07.994438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 80/157] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:07 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/da697c63336f42b3bdeff500840b8659/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:55:08.008489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe5b3e-e95b-459c-b117-8b970cf93fa5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:08.057848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:08.058519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:08.058799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:08.059110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:08.060336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:08.061840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3368c-fa93-4cc9-a90c-2d006018aa77 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:08.063843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 78/158] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:07 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:08.070325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:08.144235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:08.191378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b0092-1668-4eb3-a4f3-6a95adfcdd7b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:08.227934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:08.227934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:08.227934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:08.228290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/da697c63336f42b3bdeff500840b8659/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:08.230309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, user_id=da697c63336f42b3bdeff500840b8659, role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:08.233713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef319-0ef0-47eb-8b73-1a05d347df9a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:08.249786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 81/159] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:08 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/da697c63336f42b3bdeff500840b8659/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:09.959450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5ebc6-2684-465d-b59b-46224cd4205b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:09.960476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5ebc6-2684-465d-b59b-46224cd4205b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:09.960983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5ebc6-2684-465d-b59b-46224cd4205b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:09.962557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 79/160] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:09.967994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209eec-eb5f-490b-9cf6-0a305042790f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:09.968436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209eec-eb5f-490b-9cf6-0a305042790f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:09.968527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209eec-eb5f-490b-9cf6-0a305042790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:09.987357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-09209eec-eb5f-490b-9cf6-0a305042790f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:09.988607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-09209eec-eb5f-490b-9cf6-0a305042790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:10.061374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:10.160338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bead-b2b8-4e21-b7a2-7ea821d1a8fe None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.161032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bead-b2b8-4e21-b7a2-7ea821d1a8fe None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.161523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4bead-b2b8-4e21-b7a2-7ea821d1a8fe None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.163119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 80/162] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:10.168396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.168690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.168967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.187626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:10.188819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:10.218218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3efa0-c4cd-4d47-9fa2-508fe4d261a3 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.218486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3efa0-c4cd-4d47-9fa2-508fe4d261a3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.218683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3efa0-c4cd-4d47-9fa2-508fe4d261a3 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.220068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 81/163] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:10.225041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f725-78e9-4f2a-9538-077ac2c2d357 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.225327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f725-78e9-4f2a-9538-077ac2c2d357 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.225605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f725-78e9-4f2a-9538-077ac2c2d357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.240100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.244882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4dc6f725-78e9-4f2a-9538-077ac2c2d357 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:10.246074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4dc6f725-78e9-4f2a-9538-077ac2c2d357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:10.258947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 83/164] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:10.289567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.319946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 82/165] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:10.350513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.455274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3c92d-099b-4b10-b67a-0a5b865102c2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.474290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09daa-c4e5-4574-b0b1-1fe911c83efb None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.474290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09daa-c4e5-4574-b0b1-1fe911c83efb None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.474518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09daa-c4e5-4574-b0b1-1fe911c83efb None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.476139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 83/166] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:10.483897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.484188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.484629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.492248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.493179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.493652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.494131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.503753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:10.504943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:10.505776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:10.510965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:10.511890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:10.512773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:10.520405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 84/167] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:10.525499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.574102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.585388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 84/168] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:10.586128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.640474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d148-3d55-4ef6-be6e-891e889b2c47 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.679125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.679736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.680013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.680284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.680943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:10.681240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:10.682602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:10.690769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 85/169] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:10.691576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.700494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970deca-8af6-4365-a357-7a9d1018730e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.703628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.738074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.738922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.739233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.739671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.740761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:10.742190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:10.747120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 85/170] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:10.747120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.804261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad76-522b-425d-9777-04d5eab86b66 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.812211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.840579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.841214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.841490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.841759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.849940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43e8dc-758f-49d2-8f8f-cb3c90be2b5e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.852928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:10.858198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:10.859086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:10.859861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:10.860719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.884646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.885280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.885560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.885844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] PATH_INFO: `/v3/users/82a37df23e5847aa819fc9d643d27328` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.899307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] RBAC: Authorizing `identity:get_user(user_id=82a37df23e5847aa819fc9d643d27328)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:10.900749 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:10.902352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 86/172] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/users/82a37df23e5847aa819fc9d643d27328 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:10.907048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:10.936102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:10.960608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563a8e-3869-4cda-ad1e-3850ac5561fd None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:10.993307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:10.993883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:10.994101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:10.994368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:10.995009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:10.996456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.004614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2a52-68ae-4f86-9dec-fd220f5a393c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.017438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 87/173] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:10 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:11.018977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.041041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.041754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.042031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.042299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.055660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:11.060981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:11.062066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:11.063118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:11.066496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.068459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.160503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03ea07-78ce-4f85-a2b4-a42ba69b71a8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.173100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.185470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df86d-f519-4f4c-a874-96120fa15f37 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.201012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.201631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.201910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.202178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.203166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:11.203166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.204540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.213026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 88/175] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:11.214109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.227610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.228557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.228840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.229118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.230257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.231765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.233563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 88/176] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:11.234180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.318757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.343285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911747fb-bc95-4b6d-8e9c-fe360cef5ba5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.356275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ed08a-9d32-4888-b200-d250cd3123c3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.383952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.384823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.385114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.385378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.386037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:11.386339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.387732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.396929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 89/177] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:11.397542 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.402011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.402667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.402945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.403243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] PATH_INFO: `/v3/users/da697c63336f42b3bdeff500840b8659` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.404496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] RBAC: Authorizing `identity:get_user(user_id=da697c63336f42b3bdeff500840b8659)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.405953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.407989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 89/178] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/users/da697c63336f42b3bdeff500840b8659 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:11.408429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.446823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.527214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e421c-4a1b-4606-9de3-8c2d7ddfc751 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.544234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b5da3-9f60-4578-834c-b162e3a004ba None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.568365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.569243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.569554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.569920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/82a37df23e5847aa819fc9d643d27328/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.572034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, user_id=82a37df23e5847aa819fc9d643d27328, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.573531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.588536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.589395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.589912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.590327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] PATH_INFO: `/v3/users/da697c63336f42b3bdeff500840b8659` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.590621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 90/179] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:11 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/82a37df23e5847aa819fc9d643d27328/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:11.591632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.592334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] RBAC: Authorizing `identity:get_user(user_id=da697c63336f42b3bdeff500840b8659)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.594066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.596083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 90/180] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/users/da697c63336f42b3bdeff500840b8659 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:11.602283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:11.602482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.718272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.728242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92325-7857-4ec3-935a-4b026ae10835 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.733758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43458cb-56df-4c7b-8a2b-20225c64e45e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:11.769221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.770401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.770924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.771424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.780161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:11.780784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:11.781058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:11.781328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:11.853036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.854882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.885974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:11.887599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:11.898931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.972070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:11.983106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:11.989559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:12.017092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 91/182] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:12.024777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:12.116653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6bdbd-897b-4120-acfb-b65d78c80c97 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:12.160586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:12.162099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:12.162575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:12.163091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:12.164751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:12.166764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:12.168644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 92/183] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:11 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:12.175340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:12.217367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb36f6-50e4-47ec-933d-1393c93c8b9d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:12.230222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:12.250034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:12.295222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4e70a-c2b6-49fb-8ad5-316591b3c767 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:12.320326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:12.320974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:12.321253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:12.321523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:12.327415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:12.328938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:12.331124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 92/184] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:12 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:12.335447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:12.336285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:12.336800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:12.336907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:12.337455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:12.338368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] RBAC: Adding query filter params (role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5, scope.project.id=745004e0bef64e358963d5ebd54b1fe7, user.id=da697c63336f42b3bdeff500840b8659) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:12.338876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:12.341579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51bea6-42f8-4c8c-bd66-83122514f56a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:12.349287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 93/185] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:12 2022] GET /identity/v3/role_assignments?user.id=da697c63336f42b3bdeff500840b8659&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:12.469123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d0a2-1ea6-40a4-a0ec-3b21164a68ab None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:12.506913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:12.507962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:12.508439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:12.508900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:12.509850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=745004e0bef64e358963d5ebd54b1fe7, user.id=da697c63336f42b3bdeff500840b8659) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:12.510359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:12.512016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e6f8-41f8-4528-a4aa-69447359a96b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:12.518953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 93/186] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:12 2022] GET /identity/v3/role_assignments?user.id=da697c63336f42b3bdeff500840b8659&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:13.487807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0bd8-60eb-4d9e-820a-5c0021bcaa9e None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:13.488314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0bd8-60eb-4d9e-820a-5c0021bcaa9e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:13.488388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db0bd8-60eb-4d9e-820a-5c0021bcaa9e None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:13.489891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 94/187] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:13.494994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:13.495403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:13.495572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:13.514608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:13.518725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:13.533184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16a9-2d65-45ac-8222-d293b8a677a1 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:13.533464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16a9-2d65-45ac-8222-d293b8a677a1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:13.533776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d16a9-2d65-45ac-8222-d293b8a677a1 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:13.535381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 95/188] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:13.540050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:13.540331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:13.540603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:13.549905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:13.560415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:13.561963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:13.588786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:13.636507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:13.860207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:13.903641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:13.962700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d91bf-d02f-4f44-8909-6b32f1e7f7cd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:13.962919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:13.998983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:13.999637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:13.999920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.000190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.001282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.002742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.004337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:14.009616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.015579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c651-231d-4659-8b20-3332c91a5083 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.044748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.052421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.053308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.053755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.054216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.064609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:14.070223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:14.071173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:14.072126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:14.076917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.118410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8887-457a-4e88-9713-e803c619f4e2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.156175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.156725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.157005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.157281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.158121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.160306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966ebf-920c-42f1-8460-3103015d605e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.183105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 96/193] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:14 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:55:14.197314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7f5a-2b21-4513-aa69-6f79dffca972 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.216936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.232752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c637a2-437f-4b2d-988e-989881106c38 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.233406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c637a2-437f-4b2d-988e-989881106c38 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.233692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c637a2-437f-4b2d-988e-989881106c38 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.235497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 97/194] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:14.238448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.239096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.239406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.239678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.240361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:14.240668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.241741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.242027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.242116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.242348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.251916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 98/195] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:14.257311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.262643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:14.263952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:14.341634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 98/196] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:14.376022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551343b-8688-47f8-bbca-fb080d55544c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.412244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.412873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.413147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.413418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] PATH_INFO: `/v3/users/6dc0179dbdc4435a95ec1ce938cd21fc` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.427692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6dc0179dbdc4435a95ec1ce938cd21fc)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.429131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.430758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 99/197] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/users/6dc0179dbdc4435a95ec1ce938cd21fc => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:14.436427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.464329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.548022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32418a-41cf-4d0e-9a95-4feb1d9b5493 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.584315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.584966 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.585247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.585520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.586636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.588104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.589742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:14.595572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.610211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.638037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.719863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.725131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f9d9-1433-490c-9102-19ab3810e5d8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.732575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492e6ef-e67f-4eb7-a2b5-4532a6b50d39 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.772078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.772844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.773226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.773499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/6dc0179dbdc4435a95ec1ce938cd21fc/roles/72e82c45f8d74e2eb6ebcffcb679331c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.775008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.775688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, user_id=6dc0179dbdc4435a95ec1ce938cd21fc, role_id=72e82c45f8d74e2eb6ebcffcb679331c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.775792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.776101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.776443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.777320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.789180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:14.793829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 100/199] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:14 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/users/6dc0179dbdc4435a95ec1ce938cd21fc/roles/72e82c45f8d74e2eb6ebcffcb679331c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:14.799852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:14.800785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:14.802196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 100/200] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:14.808302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:14.923280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:14.931729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962a90e-d237-4734-8336-edcca8b51fd3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:14.972363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:14.972983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:14.973262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:14.973532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:14.974189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:14.974488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:14.976022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:14.984790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:14.990431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:15.098881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8b188-7577-4011-acd4-e12d4c26d8a0 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:15.135416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:15.136050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:15.136322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:15.136591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] PATH_INFO: `/v3/users/82a37df23e5847aa819fc9d643d27328` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:15.137712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] RBAC: Authorizing `identity:get_user(user_id=82a37df23e5847aa819fc9d643d27328)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:15.139176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:15.140749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 101/202] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:14 2022] GET /identity/v3/users/82a37df23e5847aa819fc9d643d27328 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:15.148159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:15.253050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190467a-8b61-46a9-888b-537621bfdb95 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:15.290376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:15.291095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:15.291380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:15.291647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:15.322611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:15.365561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:15.366999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:15.471243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 102/203] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:15.473047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:15.492464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:15.576324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751af2e-4178-4e41-80c8-e81c5f8d27d6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:15.611342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:15.612051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:15.612326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:15.612594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:15.613707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:15.615204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94088e97-0ed9-43ba-992f-4c4964eb1d1a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:15.621637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 102/204] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:15 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:15.623003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:15.684107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:15.732658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e6ab-6b21-4852-88fa-341fab8f98e9 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:15.769068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:15.769692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:15.770141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:15.770428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:15.771206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] RBAC: Adding query filter params (role.id=38335e20ab1a4ff9976fcfd55484637f, scope.project.id=745004e0bef64e358963d5ebd54b1fe7, user.id=82a37df23e5847aa819fc9d643d27328) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:15.771518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:15.772965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c1d27-6d4b-4c96-8a20-567de1c45ed0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:15.779554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:15 2022] GET /identity/v3/role_assignments?user.id=82a37df23e5847aa819fc9d643d27328&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:16.553607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c336-c4b5-44c1-aa6a-ccbb9ac48985 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:16.553914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c336-c4b5-44c1-aa6a-ccbb9ac48985 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:16.554145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c336-c4b5-44c1-aa6a-ccbb9ac48985 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:16.555657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 103/206] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:16.560560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:16.560847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:16.561126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:16.578971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:16.580189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:16.631294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7449-3a1e-411f-9546-3f2ae09de443 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:16.631831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7449-3a1e-411f-9546-3f2ae09de443 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:16.631831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7449-3a1e-411f-9546-3f2ae09de443 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:16.633162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 104/207] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:16.638067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:16.638393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:16.638625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:16.650195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 104/208] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:16.657198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:16.658372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:16.725342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 105/209] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:16.916039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:16.972078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:16.992202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.009968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.026282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8c3ff-d5f6-4f39-871b-880c5f246d09 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.062221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.062844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.063147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.063418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.073159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-9a93faa0-63d0-4208-8a24-5b5766c83342 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:17.077911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:17.078807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:17.079709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 105/210] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:17.084940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b7b5-247a-47c3-b9fb-3f37f51d1e08 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.085219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b7b5-247a-47c3-b9fb-3f37f51d1e08 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.085491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580b7b5-247a-47c3-b9fb-3f37f51d1e08 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.086748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 106/211] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:17.087455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580b7b5-247a-47c3-b9fb-3f37f51d1e08 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.097531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123423c-10bb-4253-8357-5a3c0202034c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.131295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.131938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.132214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.132488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.133578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.135008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6767834-8af0-422a-9206-698611cd48ac None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.136596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 106/212] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:17.140334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.140622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.140941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.158372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:17.160083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:17.188525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580b7b5-247a-47c3-b9fb-3f37f51d1e08 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.201177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.222851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.223484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.223761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.224028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.224676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:17.224971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.239427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 107/213] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:17.239427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.239683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.239683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 107/214] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:17.240227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.240994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.329408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a018e-adca-4957-aa6d-fc3ebaff1cb8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.354031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a702-c916-410d-acae-03884fcca573 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.364798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.365410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.366006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.366289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.367130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.368562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.390392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.390591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 108/215] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:17 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:17.390842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.391149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.391426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] PATH_INFO: `/v3/users/8752abe1a422420495c427b99c4c645e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.407487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8752abe1a422420495c427b99c4c645e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.409202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.411414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 108/216] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/users/8752abe1a422420495c427b99c4c645e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:17.419163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.496599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.501695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.535932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882427d-0fa4-422f-b632-fbb896cafd2b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.545465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.575104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.575869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.576911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.576911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.577395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] RBAC: Adding query filter params (role.id=38335e20ab1a4ff9976fcfd55484637f, user.id=8752abe1a422420495c427b99c4c645e, scope.system=all) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:17.577807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.579353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.584850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 109/217] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/role_assignments?user.id=8752abe1a422420495c427b99c4c645e&scope.system=all&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:17.632734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c549-5569-4976-98d0-19b0cbfae4b6 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.671831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.672585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.672745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.673011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.686180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:17.691790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:17.692800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:17.693582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 109/218] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:17.699366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.816424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25b47b-89e3-4a41-a8ba-b76bc374c766 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:17.852404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:17.853276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:17.853698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:17.854126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:17.854985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:17.855450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:17.856968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:17.858694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.867621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:17.875953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:17.975166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:17.989160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb02ac-7068-412a-b83a-8b804ae379f7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:18.026232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:18.027332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:18.027818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:18.028310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] PATH_INFO: `/v3/users/6dc0179dbdc4435a95ec1ce938cd21fc` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:18.029654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=6dc0179dbdc4435a95ec1ce938cd21fc)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:18.031328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:18.033173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 110/220] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:17 2022] GET /identity/v3/users/6dc0179dbdc4435a95ec1ce938cd21fc => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:18.040567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:18.148912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d4f81-2930-43c6-add7-2d8e900fdae0 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:18.183698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:18.184329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:18.184574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:18.184838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:18.245862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:18.252211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:18.253898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:18.354198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:18.359627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:18.469558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69071b8-0237-4226-acae-608d4da2b6f8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:18.513659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:18.514637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:18.515531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:18.516005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:18.517332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:18.519064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca67b1-cf3e-4c80-9f6b-a294efe20659 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:18.521124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 111/222] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:18 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:18.527818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:18.629585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:18.635164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef692-9a05-43b2-8114-77c8becf3512 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:18.668971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:18.669562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:18.669836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:18.670104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:18.670813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] RBAC: Adding query filter params (role.id=72e82c45f8d74e2eb6ebcffcb679331c, scope.project.id=745004e0bef64e358963d5ebd54b1fe7, user.id=6dc0179dbdc4435a95ec1ce938cd21fc) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:18.671134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:18.672568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912453c-5820-481e-a026-8859c9f7bc00 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:18.678489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 112/223] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:18 2022] GET /identity/v3/role_assignments?user.id=6dc0179dbdc4435a95ec1ce938cd21fc&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=72e82c45f8d74e2eb6ebcffcb679331c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:19.774560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb129d-5ebc-4b15-aae8-822d3a7d4d6d None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.775060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb129d-5ebc-4b15-aae8-822d3a7d4d6d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.775060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb129d-5ebc-4b15-aae8-822d3a7d4d6d None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.776438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 112/224] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:19.781790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1222d6-b4bd-48b6-99f3-5f79a9afc5f9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.782179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1222d6-b4bd-48b6-99f3-5f79a9afc5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.782372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1222d6-b4bd-48b6-99f3-5f79a9afc5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.802230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ba1222d6-b4bd-48b6-99f3-5f79a9afc5f9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:19.803466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ba1222d6-b4bd-48b6-99f3-5f79a9afc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:19.804304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760c-767f-4e6e-bf68-a69dd6ef9c4d None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.804590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760c-767f-4e6e-bf68-a69dd6ef9c4d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.804866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92760c-767f-4e6e-bf68-a69dd6ef9c4d None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.806337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 113/225] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:19.811195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.811484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.811761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.829917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:19.831672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:19.856346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:19.873708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 113/226] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:19.875009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800973-a9ea-455d-a6af-1c1d4ad43a0a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.875334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800973-a9ea-455d-a6af-1c1d4ad43a0a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.875609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800973-a9ea-455d-a6af-1c1d4ad43a0a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.876846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 114/227] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:19.881933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:19.882217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:19.882491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:19.901263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:19.902671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:19.907305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 114/228] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:19.970590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 115/229] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:20.145461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.176743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.203526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.255567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d59da-6dee-4bd6-ab2b-5c63146d41f7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.279106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e8e00-ac47-48d3-b0ad-9f93c32ac63e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.288926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.289558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.289834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.290103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.300625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:20.305656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:20.306528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:20.307336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 115/230] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:20.307985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.316303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.316936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.317237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.317510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.326637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.327645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:20.332692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:20.333547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 116/231] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:20.339302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.407019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd176d-c740-4db5-8405-78ddb28bcbeb None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.414667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.434356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145f4b5-ccb8-47af-a4e2-344fd41fa9c3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.441262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.441893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.442166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.442436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.443572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.445030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.446803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:20.447376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.467753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.468356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.468637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.468909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.469566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:20.469871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.471794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.479628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 117/233] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:20.480381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.536095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.551429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae578-2712-48cd-a5bd-3e5dcbdc97b0 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.578063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72ccd-0b44-44d8-8bc0-c0d897208935 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.584844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.585568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.585842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.586114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.586777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:20.587093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.588499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.596432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 117/234] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:20.597207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.614441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.615045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.615349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.615621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] PATH_INFO: `/v3/groups` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.616242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.617646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.633104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 118/235] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Oct 22 23:55:20 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:20.633890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.636386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.725540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445aad5-1fb6-418f-b750-f8717e886a8e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.750869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccec2d-9b86-4914-8100-1e53e8fb0eda None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.760983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.761640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.761918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.762192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] PATH_INFO: `/v3/users/c239b16372d34b24a174f42d00fbdf61` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.777007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c239b16372d34b24a174f42d00fbdf61)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.778496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.780452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 118/236] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/users/c239b16372d34b24a174f42d00fbdf61 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:20.786733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.790397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.791048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.791379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.791651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] PATH_INFO: `/v3/users/8752abe1a422420495c427b99c4c645e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.792835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] RBAC: Authorizing `identity:get_user(user_id=8752abe1a422420495c427b99c4c645e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.794297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.796110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 119/237] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/users/8752abe1a422420495c427b99c4c645e => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:20.797168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.801681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:20.881324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:20.900076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15040-f965-49b0-bb3c-38aaab81f9a5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.919547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddfa6-73ff-4d7e-902e-94be83bf1b7b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:20.936795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.937693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.937970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.938238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.939015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] RBAC: Adding query filter params (role.id=72e82c45f8d74e2eb6ebcffcb679331c, user.id=c239b16372d34b24a174f42d00fbdf61, scope.system=all) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:20.939363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.941760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d33f-2a69-4970-b5aa-34e5504f198c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.946910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 119/238] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Oct 22 23:55:20 2022] GET /identity/v3/role_assignments?user.id=c239b16372d34b24a174f42d00fbdf61&scope.system=all&role.id=72e82c45f8d74e2eb6ebcffcb679331c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:20.954641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:20.955407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:20.955701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:20.955973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] PATH_INFO: `/v3/system/users/8752abe1a422420495c427b99c4c645e/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:20.957487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8752abe1a422420495c427b99c4c645e, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:20.958894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abef18e-c547-416a-9bfe-2cfb63532e2b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:20.971970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 120/239] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Oct 22 23:55:20 2022] PUT /identity/v3/system/users/8752abe1a422420495c427b99c4c645e/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:55:22.826065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794e9f-7e20-4585-9d10-ad9f2eb41c9a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:22.826541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794e9f-7e20-4585-9d10-ad9f2eb41c9a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:22.826541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0794e9f-7e20-4585-9d10-ad9f2eb41c9a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:22.828052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 120/240] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:22.833706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7219e-de0e-4d24-aa7b-8916e8442815 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:22.834077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7219e-de0e-4d24-aa7b-8916e8442815 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:22.834267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7219e-de0e-4d24-aa7b-8916e8442815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:22.852771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a7b7219e-de0e-4d24-aa7b-8916e8442815 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:22.853955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a7b7219e-de0e-4d24-aa7b-8916e8442815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:22.921475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 121/241] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:23.070383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a2f4-3856-43d4-8a06-1438c0f2c25c None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.070656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a2f4-3856-43d4-8a06-1438c0f2c25c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.071099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a2f4-3856-43d4-8a06-1438c0f2c25c None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.072603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 121/242] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:23.077594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.077881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.078153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.096700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:23.097863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:23.117488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce21bd-4e7c-45f8-a525-e6c8df40e895 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.117769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce21bd-4e7c-45f8-a525-e6c8df40e895 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.118040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce21bd-4e7c-45f8-a525-e6c8df40e895 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.119616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 122/243] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:23.124681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.124979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.125249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.143386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:23.144824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:23.161487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.172532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 122/244] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:23.193848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.226273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.231148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:23.297361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838748b9-a391-482f-9829-cb59fd23f917 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.331204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.331775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.332055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.332325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.333420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:23.334841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:23.336587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 123/246] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:23.341884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.439897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.443161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9269e8-8784-4e6d-bfe3-7443e3cb7c71 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.477714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.478314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.478590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.478859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] PATH_INFO: `/v3/groups` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.479515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:23.480929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:23.502256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 124/247] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Oct 22 23:55:23 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:23.509088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.526055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.571436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2ab86-e564-4493-bff1-e15299d6d19c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.587524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.614175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.614874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.615302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.615395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.631009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:23.636107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:23.637054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:23.637834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 124/248] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:23.641085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e250f5b-9742-42c8-be6f-7dd66693c000 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.643753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.681366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.682134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.682415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.682686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.698206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:23.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:23.705274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:23.706610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 125/249] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:23.712960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.768569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5254-5a67-4e2b-822b-12dfa6893b7c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.797255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.817488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.818108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.818383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.818655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.819381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:23.819679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:23.821068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:23.832242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:23.835812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7858c3-6487-4d14-b3cf-1a6704af07f3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:23.837591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.859162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:23.883058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:23.884118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:23.884605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:23.885017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:23.885712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:23.886017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:23.887500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:23.899118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 126/251] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:23.902314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:23.975603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f101-d949-4d20-9e01-8e381b035cca None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:24.020458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:24.021095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:24.021370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:24.021639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] PATH_INFO: `/v3/users/c239b16372d34b24a174f42d00fbdf61` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:24.023447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] RBAC: Authorizing `identity:get_user(user_id=c239b16372d34b24a174f42d00fbdf61)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:24.025182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:24.031181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 126/252] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/users/c239b16372d34b24a174f42d00fbdf61 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:24.037808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:24.040910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e85b-c6fa-41a3-b088-7aea80db4f96 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:24.093578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:24.094112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:24.094394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:24.094808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] PATH_INFO: `/v3/users/8752abe1a422420495c427b99c4c645e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:24.097557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=8752abe1a422420495c427b99c4c645e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:24.099040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:24.100924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 127/253] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:23 2022] GET /identity/v3/users/8752abe1a422420495c427b99c4c645e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:24.105945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:24.106859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:24.181150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e35d-f9f9-48e5-be44-9bfd21dc5a55 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:24.184190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:24.230149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:24.230817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:24.231141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:24.231438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] PATH_INFO: `/v3/system/users/c239b16372d34b24a174f42d00fbdf61/roles/72e82c45f8d74e2eb6ebcffcb679331c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:24.232863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c239b16372d34b24a174f42d00fbdf61, role_id=72e82c45f8d74e2eb6ebcffcb679331c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:24.234242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bb943-78bd-4863-a946-bd7399c3ca13 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:24.244965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 127/254] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Oct 22 23:55:24 2022] PUT /identity/v3/system/users/c239b16372d34b24a174f42d00fbdf61/roles/72e82c45f8d74e2eb6ebcffcb679331c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:24.263692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd363f6-6889-4ba6-b330-f5235264e1a9 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:24.305227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:24.306371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:24.306953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:24.307445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:24.308485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] RBAC: Adding query filter params (role.id=38335e20ab1a4ff9976fcfd55484637f, user.id=8752abe1a422420495c427b99c4c645e, scope.system=all) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:24.309047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:24.310847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f1074-320c-4588-a11e-a36a1feda5f6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:24.326790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 128/255] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Oct 22 23:55:24 2022] GET /identity/v3/role_assignments?user.id=8752abe1a422420495c427b99c4c645e&scope.system=all&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:25.982454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0b76-af32-4239-bba8-cae2f68e078f None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:25.982956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0b76-af32-4239-bba8-cae2f68e078f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:25.983058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a0b76-af32-4239-bba8-cae2f68e078f None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:25.984414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 128/256] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:25.999242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be889-fe3c-4125-ba70-8313f35c9375 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.000106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be889-fe3c-4125-ba70-8313f35c9375 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.000585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3be889-fe3c-4125-ba70-8313f35c9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.024649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1b3be889-fe3c-4125-ba70-8313f35c9375 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:26.026198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1b3be889-fe3c-4125-ba70-8313f35c9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:26.115571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 129/257] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 23:55:26.285500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d331-5d84-4156-8cf0-a5a5f87d574b None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.286131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d331-5d84-4156-8cf0-a5a5f87d574b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.286601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d331-5d84-4156-8cf0-a5a5f87d574b None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.288251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 129/258] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:26.293835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.294370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.294853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.323534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:26.325128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:26.337838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 130/259] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 23:55:26.640585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d331-5d84-4156-8cf0-a5a5f87d574b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.656610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d331-5d84-4156-8cf0-a5a5f87d574b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.661664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.662346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.662629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.662902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.678601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:26.683445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:26.684293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:26.685062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:26.689281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 130/260] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:26.691247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.705423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c2e9-7cb8-46bd-a34e-cf113949b8a6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.723734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.724369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.724653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.724931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.725602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:26.725913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:26.727799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:26.727799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 22 23:55:26.727799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 22 23:55:26.728709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:26.741556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 131/261] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:26.746923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.760169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a1a9-cb56-4501-8b3a-36551261e6d0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.766379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.767013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.767315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.767587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.777053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:26.778809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:26.778809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 22 23:55:26.778809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 22 23:55:26.780072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:26.782909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 131/262] 10.222.0.20 () {56 vars in 1201 bytes} [Sat Oct 22 23:55:26 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:26.788067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.804890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db95f2-950a-4569-a7eb-11feefccf5c1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.815224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.815867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.816149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.816426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.823798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:26.825968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:26.827922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 132/263] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:55:26 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:26.833437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.848769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388929-8ddf-4db7-afd8-501eebc4c5e1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.863913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.864598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.864880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.865176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/groups/636dad7152674d43b456196a1d3d360c/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:26.867219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, group_id=636dad7152674d43b456196a1d3d360c, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:26.868229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:26.868229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 22 23:55:26.868229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 22 23:55:26.870200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:26.883817 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:26.892409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 132/264] 10.222.0.20 () {58 vars in 1463 bytes} [Sat Oct 22 23:55:26 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/groups/636dad7152674d43b456196a1d3d360c/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:26.900975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348bcbd-bbbb-448b-9840-00ee68b722e1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:26.946190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:26.984897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:26.985547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:26.985824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:26.986099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.008090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:27.013061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:27.015237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:27.017167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 133/265] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:55:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:27.020453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.045852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc692c4-cd06-482b-89fb-f274222900f9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.061476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.062114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.062394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.062667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.063387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:27.063686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.064734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:27.064734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 22 23:55:27.064734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 22 23:55:27.065642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.078998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 133/266] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.085153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.100638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8771a3-e80b-47b5-8ad6-f18897ed7751 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.111182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.112381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.112660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.112987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.119841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.120876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:27.120876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 22 23:55:27.120876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 22 23:55:27.122115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.124006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 134/267] 10.222.0.20 () {56 vars in 1201 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.129816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.144969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4cede-c2bb-4788-80cc-4d18789910ba admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.155422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.156089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.156355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.156628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.159947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.162037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ca22a-b85b-4ffc-871e-15fe5c4f10d8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.163802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 134/268] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.169573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.179439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e50c0-caae-4273-918e-8825d186b906 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.179705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e50c0-caae-4273-918e-8825d186b906 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.179857 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e50c0-caae-4273-918e-8825d186b906 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.181450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 135/269] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:27.184952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3aa0-885c-438a-ba8e-04ea68adb902 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.195488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.196182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.196464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.196740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/groups/636dad7152674d43b456196a1d3d360c/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.199806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.199999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0877e8ca949c4981b340cbf072b4a4ba, group_id=636dad7152674d43b456196a1d3d360c, role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.200152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.200347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.200855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 23:55:27.200855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 22 23:55:27.200855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 22 23:55:27.202826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e6c9-c3ca-4206-87cf-0e6adc1ee063 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.223680 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1463 bytes} [Sat Oct 22 23:55:27 2022] PUT /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba/groups/636dad7152674d43b456196a1d3d360c/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:27.235493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:27.237270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:27.244873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12332-79a9-4c2b-b367-b3fad58cba80 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.245200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12332-79a9-4c2b-b367-b3fad58cba80 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.245428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12332-79a9-4c2b-b367-b3fad58cba80 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.247086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 136/271] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:27.254802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.255173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.255379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.283180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:27.284740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:27.375565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:27.386731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 136/272] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:27.397103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 137/273] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 22 23:55:27.806250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.821419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05887c6b-1056-494c-8096-30d4975d61ae None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.825978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.826614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.826893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.827193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.843186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:27.848288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:27.850335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:27.852299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 137/274] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:27.856754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.869807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dbcd7-57a4-42cd-9b0a-812c28268a07 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.880701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.881340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.881626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.881900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.882584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:27.882890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.884569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.896743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 138/275] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.902226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.913493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012775-e60d-488a-ae1d-c1584477fdb0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.923347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.924513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.924789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.925060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.926206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.928484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.931124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.934127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 138/276] 10.222.0.20 () {56 vars in 1201 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.940090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.950104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ff39-cd6a-40d6-a5de-c2be722883d4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:27.959645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:27.960264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:27.960542 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:27.960815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:27.967046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:27.969171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:27.971009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 139/277] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:27.984589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:27.996270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3e521-4199-45e3-bcc5-db2fbbedc938 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:28.006905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:28.007609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.007885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.008161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/groups/636dad7152674d43b456196a1d3d360c/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.016360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, group_id=636dad7152674d43b456196a1d3d360c, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:28.019611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:28.043783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 140/278] 10.222.0.20 () {58 vars in 1463 bytes} [Sat Oct 22 23:55:27 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/groups/636dad7152674d43b456196a1d3d360c/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:55:28.070935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:28.081155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d9c9-3f20-461f-bd5f-32696d7331c6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:28.132982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:28.133652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.133931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.134208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.148262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:28.153780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:28.154670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:28.155533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 139/279] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:28.162104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:28.348131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e226-d4a6-4806-ad0c-38150a8e038e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:28.389553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:28.390192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.390473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.390749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.391452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:28.391757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:28.393196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b56182-7b65-4550-abdd-6915d946af89 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:28.402647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:28.408030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:28.492347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7a104-6ad1-457c-a7fc-9372e88cdb48 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.492686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7a104-6ad1-457c-a7fc-9372e88cdb48 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.492956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7a104-6ad1-457c-a7fc-9372e88cdb48 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.494622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 142/281] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:28.503108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.503108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.503108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.527833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:28.529436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:28.551238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d8bc-8705-4e91-947b-a8fc3e333904 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:28.586492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:28.623932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:28.624663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.624954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.625233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] PATH_INFO: `/v3/users/c239b16372d34b24a174f42d00fbdf61` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.629458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c239b16372d34b24a174f42d00fbdf61)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:28.631194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:28.632984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 140/282] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:55:28 2022] GET /identity/v3/users/c239b16372d34b24a174f42d00fbdf61 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:28.638547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 143/283] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 23:55:28.638824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:28.681314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:28.771471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c508-790c-4ec9-b1aa-e8918f91c5e1 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:28.813972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:28.814642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:28.814922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:28.815224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:28.815951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] RBAC: Adding query filter params (role.id=72e82c45f8d74e2eb6ebcffcb679331c, user.id=c239b16372d34b24a174f42d00fbdf61, scope.system=all) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:28.816259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:28.817674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:28.834784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 141/284] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Oct 22 23:55:28 2022] GET /identity/v3/role_assignments?user.id=c239b16372d34b24a174f42d00fbdf61&scope.system=all&role.id=72e82c45f8d74e2eb6ebcffcb679331c => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:29.030468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.044172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae1ed-7aba-43df-a7a3-af4177280940 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.048646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.049355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.049635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.049911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.067610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:29.072780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:29.074968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:29.076933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 144/285] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:29.086605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.105268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168cf66-0422-4c94-a176-dfa64e3c1dce None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.116221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.117213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.117711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.118176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.119116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:29.119614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.121406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.135941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 142/286] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.142026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.156696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbfbec-05a2-48bb-a322-f0a22c8f971a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.161886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.162537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.162815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.163100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.164279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.166186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488c36b-345b-4045-8c20-088d0d42d8b9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.171976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 145/287] 10.222.0.20 () {56 vars in 1201 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.178798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.192434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326696-496e-4e20-b9f7-1ab987f3f940 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.203357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.204343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.204840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.205345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.211863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.214174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8075c-89a1-4a43-8964-f80086cb3cc6 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.214462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8075c-89a1-4a43-8964-f80086cb3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.214740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8075c-89a1-4a43-8964-f80086cb3cc6 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.215046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.216136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 146/288] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:29.217381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 143/289] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.221965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.222248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.222521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.224848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.236215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20aa36-de5f-4b94-84c4-ea0b277c1769 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.246794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.247776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.248260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.248750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7/groups/636dad7152674d43b456196a1d3d360c/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.249443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:29.255093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:29.256494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745004e0bef64e358963d5ebd54b1fe7, group_id=636dad7152674d43b456196a1d3d360c, role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.259429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.262570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 147/290] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 23:55:29.286092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 144/291] 10.222.0.20 () {58 vars in 1463 bytes} [Sat Oct 22 23:55:29 2022] PUT /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7/groups/636dad7152674d43b456196a1d3d360c/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:55:29.564541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.575414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9ea98-da06-4603-9c05-b6e3eb3ffe95 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.645491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.646383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.646665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.646942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.663047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:29.668255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:29.669103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:29.669895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:29.672161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 148/292] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:29.678772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.692883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce24a-ddfb-4276-b281-9fae8f81faa3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.697415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.698021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.698302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.698577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.699259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:29.699564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.701159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.712465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 145/293] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.717780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.733560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249e565-75f2-4c81-92c8-efa744fbd62f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.738356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.739029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.739337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.739669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] PATH_INFO: `/v3/groups/11575468ee7643c3a09d0f68fa06db9b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.745166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] RBAC: Authorizing `identity:get_group(group_id=11575468ee7643c3a09d0f68fa06db9b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.747176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.748883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 149/294] 10.222.0.20 () {56 vars in 1201 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/groups/11575468ee7643c3a09d0f68fa06db9b => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.754901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.765456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c8f6-20be-483e-84d1-6044bb59768f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.770608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.771318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.771602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.771934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] PATH_INFO: `/v3/projects/c3ab34f677c3438798ed2f88102aad11` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.773111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] RBAC: Authorizing `identity:get_project(project_id=c3ab34f677c3438798ed2f88102aad11)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.775085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48170-60b3-4b59-ab72-512ca7f12e3a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.777147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 146/295] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Oct 22 23:55:29 2022] GET /identity/v3/projects/c3ab34f677c3438798ed2f88102aad11 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:29.782848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:29.793354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4503a-7d20-40e8-8e7e-b3a401881aa9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:29.798027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:29.798731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:29.799101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:29.799379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] PATH_INFO: `/v3/projects/c3ab34f677c3438798ed2f88102aad11/groups/11575468ee7643c3a09d0f68fa06db9b/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:29.801450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ab34f677c3438798ed2f88102aad11, group_id=11575468ee7643c3a09d0f68fa06db9b, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:29.804647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69252-36b4-4c1a-8938-469b205e1dfc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:29.819187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 150/296] 10.222.0.20 () {58 vars in 1463 bytes} [Sat Oct 22 23:55:29 2022] PUT /identity/v3/projects/c3ab34f677c3438798ed2f88102aad11/groups/11575468ee7643c3a09d0f68fa06db9b/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:30.624524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d218e9-e2d9-4a5c-ad1d-21746211a128 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:30.625037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d218e9-e2d9-4a5c-ad1d-21746211a128 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:30.625111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d218e9-e2d9-4a5c-ad1d-21746211a128 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:30.626604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 147/297] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:30.634481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:30.635030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:30.635030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:30.660029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:30.661231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:30.698833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725c5e-3429-4562-8c7f-f375796ea6ea None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:30.699156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725c5e-3429-4562-8c7f-f375796ea6ea None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:30.699411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725c5e-3429-4562-8c7f-f375796ea6ea None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:30.700988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 148/298] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:30.706401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:30.706683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:30.706961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:30.744080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:30.745488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:30.750093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 151/299] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:30.804705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:30.848900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 149/300] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 22 23:55:31.048714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.053122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:31.172484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ecb17-3a7e-4179-80fd-a3a08b99090c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:31.214187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:31.214818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.215139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.215380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.228291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:31.233275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:31.234151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:31.234933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:31.239277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 152/301] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:31.244198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.251547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.334619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:31.380580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd2629-f915-45a8-8ed0-ebcec04142a8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:31.382911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c761-6b08-496a-bf71-85ab4ea698b3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:31.422114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:31.422802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.423021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.423321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.436693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:31.442657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:31.443599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:31.444384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 153/302] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:31.450316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:31.450955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.451264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.451365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.451538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.452312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:31.452618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:31.454003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:31.479610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 150/303] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:31.485143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.538526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:31.596418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56015589-d3cd-45a4-a1e7-01af896747e7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:31.619432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62499-2e2e-4561-976f-a07cb92ea30e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:31.623288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:31.633344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:31.633971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.634253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.634526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.635222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:31.635528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:31.636895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a317-d6a0-4cb9-9594-1c5ec26be6f3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:31.649596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 154/304] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:31.649596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9854a-71dd-4048-a4c3-9ea2030b0a4e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.649596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9854a-71dd-4048-a4c3-9ea2030b0a4e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.649596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9854a-71dd-4048-a4c3-9ea2030b0a4e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.649596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 155/305] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:31.655049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.655373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.655652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.666199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:31.667649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:31.668072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:31.668537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:31.679548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:31.680647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:31.746017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:31.747728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:31.751509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 156/306] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:31.752425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.781316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:31.860952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 151/307] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:31.867673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:31.982308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0aea-50b6-4e42-86e5-ebbb50e8a375 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.008954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41571494-570d-43bd-b8da-6f3698ab5c79 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.032322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.049485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.058114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.059131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.059610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.060085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.071786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.072445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.072724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.072996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.077594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.079155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.081102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 152/308] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:32.087909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.144860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.146672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faedf1d-d25d-490b-ad8c-b21efb0e7d31 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.210125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ca5f-9817-4b1b-b268-3f0adab9f4f7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.262449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.262449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.262449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.262449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.264215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.266646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.267664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 153/309] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:32.268961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.280695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 157/310] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:32.282139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cda7-f334-4de8-b239-bd34f837265a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.282579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cda7-f334-4de8-b239-bd34f837265a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.283006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cda7-f334-4de8-b239-bd34f837265a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.285419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 158/311] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:32.286738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cda7-f334-4de8-b239-bd34f837265a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.312573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.358166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.402236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc436-fe52-4fc7-a2a9-1d4afab8b32a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.421752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cda7-f334-4de8-b239-bd34f837265a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.443393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.444035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.444312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.444587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.457191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:32.462325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:32.463247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 154/312] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:32.466171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.487953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.488584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.488845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.489113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.489840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] RBAC: Adding query filter params (group.id=636dad7152674d43b456196a1d3d360c, role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:32.490141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.492102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f505-dcba-436e-8065-8016cd8ae794 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.500897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/role_assignments?group.id=636dad7152674d43b456196a1d3d360c&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:32.502802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.503455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.503934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.530430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:32.531662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:32.605365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aefe24-f7b4-4067-aa15-75baa2f60f83 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.622821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 160/314] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:32.623782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.660347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.679402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.691917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.692960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.696040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.696595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] PATH_INFO: `/v3/projects/0877e8ca949c4981b340cbf072b4a4ba` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.698074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] RBAC: Authorizing `identity:get_project(project_id=0877e8ca949c4981b340cbf072b4a4ba)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.702113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.704186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 155/315] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/projects/0877e8ca949c4981b340cbf072b4a4ba => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:32.710112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.807768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87eab3-d869-4e5e-89e1-1acf86220ac9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.859136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.859589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb5cda-8b61-45af-a266-6fec89b862bd None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:32.859784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.860086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.860360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.861142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:32.861507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.863009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118967b3-4084-4231-bf4e-3374bff20c48 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.872800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 161/316] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:32.874022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1be5-bca0-4f92-a5bc-dafaf3e6fb8c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.874303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1be5-bca0-4f92-a5bc-dafaf3e6fb8c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.874578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1be5-bca0-4f92-a5bc-dafaf3e6fb8c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.878997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 162/317] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:32.884010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca1be5-bca0-4f92-a5bc-dafaf3e6fb8c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:32.901645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:32.902387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.902670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.902944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.904258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:32.905711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a2a20-8051-419a-96fa-7e7504f88435 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:32.907766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 156/318] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:32.909443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:32.909720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:32.909993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:32.928640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:32.929827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:32.979424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:32.993998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.005451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 157/319] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:33.006287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.015159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca1be5-bca0-4f92-a5bc-dafaf3e6fb8c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.052673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.053310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.053557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.053830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.133145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.134612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.139743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccf43f-5860-401d-8286-cdc7151c7fd5 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.190562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.192025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.192025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.192025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.192779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] RBAC: Adding query filter params (group.id=636dad7152674d43b456196a1d3d360c, role.id=38335e20ab1a4ff9976fcfd55484637f, scope.project.id=0877e8ca949c4981b340cbf072b4a4ba) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:33.193061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.194487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.207160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 158/320] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/role_assignments?group.id=636dad7152674d43b456196a1d3d360c&scope.project.id=0877e8ca949c4981b340cbf072b4a4ba&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:33.207160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.231550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.271719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 163/321] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:33.277138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.279804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.333074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801005-39b7-49b3-bd63-d667b9c58eb7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.374515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.375226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.375507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.375779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.391907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:33.398585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:33.399648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 159/322] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:33.400436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.421989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e549e-92a2-495a-84b4-b184ed789854 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.465225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.465864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.466140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.466413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.467583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.469498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.472428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 164/323] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:33.473211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.522834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.536916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8f45-190c-46b2-a4eb-ebf4a2bf551b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.555806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.579496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.580198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.580486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.581743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.592553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:33.592738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b104db-66b0-40c2-9f6a-76a919c3b550 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:33.598577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:33.599498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:33.600317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 160/324] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:33.603620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.638054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.639034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.639034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.639233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.639854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:33.640153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.641598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.650859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 165/325] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:33.653185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.724021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25a99f-2e4d-4652-8048-b5069fb500da None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.761060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.761725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.762003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.762272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.763813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.765248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.766932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 161/326] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:33.767795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.771158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b5bc-cd34-4fa8-bf30-3761f118aa5d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.773675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.815709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.817519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.817955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.818230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.818900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:33.819293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.820585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:33.820693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:33.830640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 166/327] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:33.831743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:33.888735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f09a3-0f45-441f-bdfc-d588665fb600 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.928622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.929158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.929437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.929708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.954839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13afa52-9da5-4412-b5aa-0773ed915803 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:33.990839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:33.991489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:33.991770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:33.992042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:33.992763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] RBAC: Adding query filter params (group.id=636dad7152674d43b456196a1d3d360c, role.id=38335e20ab1a4ff9976fcfd55484637f, scope.project.id=745004e0bef64e358963d5ebd54b1fe7) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:33.993071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:33.994481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.000076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 167/328] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/role_assignments?group.id=636dad7152674d43b456196a1d3d360c&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=38335e20ab1a4ff9976fcfd55484637f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:34.000844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.004051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.005559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.033006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.061069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.117706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080f5ec-1cc4-4f08-9fc9-b8107f0112e6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.124990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 162/329] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:34.131297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.156530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.157156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.157442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.157720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.232855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.234233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.247173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39da87-dcdb-4535-92f0-b9f3fe04960d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.271385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.288630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.288630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.289491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.289491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] PATH_INFO: `/v3/projects/745004e0bef64e358963d5ebd54b1fe7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.290831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] RBAC: Authorizing `identity:get_project(project_id=745004e0bef64e358963d5ebd54b1fe7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.292297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.294114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 163/330] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/projects/745004e0bef64e358963d5ebd54b1fe7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:34.300313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.318388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.362593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 168/331] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:34.368474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.416460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fffdd-e680-47ec-bf91-b652ec56e64e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.451552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.452270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.452552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.452831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] PATH_INFO: `/v3/groups/636dad7152674d43b456196a1d3d360c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.453906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] RBAC: Authorizing `identity:get_group(group_id=636dad7152674d43b456196a1d3d360c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.455950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.457669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 164/332] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/groups/636dad7152674d43b456196a1d3d360c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:34.463402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.469887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad12ddd-edb6-4c7c-a549-608c629c1d69 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.495136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.503489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.504110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.504386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.504660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] PATH_INFO: `/v3/projects/c3ab34f677c3438798ed2f88102aad11` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.505791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] RBAC: Authorizing `identity:get_project(project_id=c3ab34f677c3438798ed2f88102aad11)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.507243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.508909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 169/333] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/projects/c3ab34f677c3438798ed2f88102aad11 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:34.514325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.545760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:34.564181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dbf8b-993e-4292-a0da-bf09d8e935b3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.597124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.597724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.598001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.598275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.598984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] RBAC: Adding query filter params (group.id=636dad7152674d43b456196a1d3d360c, role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5, scope.project.id=745004e0bef64e358963d5ebd54b1fe7) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:34.599318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.600726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.606459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 165/334] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/role_assignments?group.id=636dad7152674d43b456196a1d3d360c&scope.project.id=745004e0bef64e358963d5ebd54b1fe7&role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:34.610319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf9059-68ce-4a3f-b557-8733477653bc None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.647510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.648157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.648437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.648710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] PATH_INFO: `/v3/groups/11575468ee7643c3a09d0f68fa06db9b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.649838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] RBAC: Authorizing `identity:get_group(group_id=11575468ee7643c3a09d0f68fa06db9b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.651310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df010-4311-4379-894c-f96ac384ad85 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.652923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 170/335] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/groups/11575468ee7643c3a09d0f68fa06db9b => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:34.659235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:34.764643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6ae1f-0f80-4dac-ab42-fbc3bff930d4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:34.797777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:34.798379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:34.798657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:34.799482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:34.800206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] RBAC: Adding query filter params (group.id=11575468ee7643c3a09d0f68fa06db9b, role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=c3ab34f677c3438798ed2f88102aad11) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:34.800511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:34.802187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339bbf-39df-4f7f-ac4b-100e0f7ef3c5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:34.808147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 166/336] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Oct 22 23:55:34 2022] GET /identity/v3/role_assignments?group.id=11575468ee7643c3a09d0f68fa06db9b&scope.project.id=c3ab34f677c3438798ed2f88102aad11&role.id=55e94c99a5d74674bcc214e7a019295d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:37.306969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31641aa-4705-49db-9bfe-d6bed63cca26 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.307514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31641aa-4705-49db-9bfe-d6bed63cca26 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.307590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31641aa-4705-49db-9bfe-d6bed63cca26 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.309246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 171/337] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:37.315329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d171cf-d2c4-4b5a-b9e3-97d7bb45cf46 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.315767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d171cf-d2c4-4b5a-b9e3-97d7bb45cf46 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.315843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d171cf-d2c4-4b5a-b9e3-97d7bb45cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.344040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-09d171cf-d2c4-4b5a-b9e3-97d7bb45cf46 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:37.345247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-09d171cf-d2c4-4b5a-b9e3-97d7bb45cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:37.348745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:37.433301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 167/338] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:37.693565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0029-8719-480e-879d-ddb759064504 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.693841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0029-8719-480e-879d-ddb759064504 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.694275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0029-8719-480e-879d-ddb759064504 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.695768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 172/339] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:37.709773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333468-40c3-48f2-a8c3-7c73c3a394ea None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.710347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333468-40c3-48f2-a8c3-7c73c3a394ea None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.710809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333468-40c3-48f2-a8c3-7c73c3a394ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.736816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6d333468-40c3-48f2-a8c3-7c73c3a394ea None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:37.738378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6d333468-40c3-48f2-a8c3-7c73c3a394ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:37.825942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 168/340] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:37.851912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0029-8719-480e-879d-ddb759064504 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:37.943244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:37.962226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54aeb8-ae31-491a-b579-10f357ec21cd None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.962808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54aeb8-ae31-491a-b579-10f357ec21cd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.963329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54aeb8-ae31-491a-b579-10f357ec21cd None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.964903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 169/341] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:37.970060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557af4-5928-47e1-9580-0d60c2fa7768 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:37.970559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557af4-5928-47e1-9580-0d60c2fa7768 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:37.971568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557af4-5928-47e1-9580-0d60c2fa7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:37.995527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0029-8719-480e-879d-ddb759064504 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:37.999415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1d557af4-5928-47e1-9580-0d60c2fa7768 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:38.000804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1d557af4-5928-47e1-9580-0d60c2fa7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:38.030505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.031381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.031657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.031927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.044666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.046162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-d153b589-f03f-4975-ad5b-2ca911f52105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:38.066134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:38.067067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:38.067949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:38.067949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.067949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:38.069720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 173/342] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:38.071017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67f80-f209-4171-996d-22463460b7a4 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.071391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67f80-f209-4171-996d-22463460b7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.071737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67f80-f209-4171-996d-22463460b7a4 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.073096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 174/343] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:38.078214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.079014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb67f80-f209-4171-996d-22463460b7a4 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.084188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 170/344] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:38.089315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.089315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.089315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.105384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:38.107099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:38.190008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 171/345] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:38.191031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.224797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb67f80-f209-4171-996d-22463460b7a4 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.251235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.275463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.276565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.276843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.279265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.280001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:38.280311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.281792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.309758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 175/346] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:38.316643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.343316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ebb0-3c4b-4dd1-80b8-319c717ac213 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.399412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.411595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.412272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.412557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.412823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.433456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.435508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:38.456578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:38.457493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:38.458344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:38.458344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.458344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:38.460085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 172/347] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:38.460977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.474962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a448-4aec-4d7b-9b43-82d5de561826 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.511036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.511922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.512353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.512727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.513572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.515118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.538987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 176/348] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:38 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:38.546490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.589666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.596846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514447d-2e39-4a51-bbec-1079deaf0880 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.649620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.650285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.650567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.650842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.666380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.668472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.678911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ceac2-d2cd-4848-a298-9217e278d6c9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:38.687723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:38.688672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:38.690060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:38.690060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.690060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:38.690060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 173/349] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:38.695188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.729091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.730014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.730292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.731399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.732680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:38.732680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.733728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.738106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.754017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 177/350] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:38.754872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.820247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f235-4103-4940-8ba2-8d6971edfe91 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.857510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.858576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.859050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.859560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:38.860681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.869112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f1bdd-9c1b-47e5-b725-52d0f21ea013 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:38.874071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.875801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:38.892062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:38.893121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:38.893994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:38.893994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:38.893994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:38.895620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 174/351] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:38.896646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:38.911001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:38.911573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:38.911820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:38.912096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:38.912738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:38.913032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:38.914519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:38.931392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 178/352] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:38.931392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:39.004411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:39.021843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0501-9509-44a3-a700-13510f8b45d8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:39.035726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f830b4-09cf-41a1-a63a-8d67784576e8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:39.058750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:39.059855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.060346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.060848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.061734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:39.063687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:39.071608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:39.072239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.072516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.072789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.073463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:39.073753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:39.075175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:39.089563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 179/353] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:39.090410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:39.092623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 175/354] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:38 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:39.104896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:39.112116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:39.206721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda00ed-adf3-4ead-b143-e1b6323fae3a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:39.243780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:39.244396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.244673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.244943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.245596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:39.247049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346514-3d2e-4709-b2e6-751fca321f94 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:39.260564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d619c-2940-4250-a6fa-e468ac710893 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:39.273430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 180/355] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:39 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:39.274757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98719-974e-4ad4-af66-e1aa0d98b4d6 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.275046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98719-974e-4ad4-af66-e1aa0d98b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.275399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98719-974e-4ad4-af66-e1aa0d98b4d6 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.276948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 181/356] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:39.283506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.283838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.284054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.312072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:39.314272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:39.314608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:39.315462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.315852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.316251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.317056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:39.323265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:39.348108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:39.355856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 176/357] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:39 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:39.421837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:39.429668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 182/358] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:39.713760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:39.824942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2809-8e6b-411c-bc71-ccbb0285c86e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:39.865104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:39.865729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:39.866005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:39.866272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:39.866937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:39.868314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:39.877487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.sql.core [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 22 23:55:39.877487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 22 23:55:39.877487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [parameters: {'id': '70b5698358604eb49fc6107238a072a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 22 23:55:39.877487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81355) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application result.read() Oct 22 23:55:39.897531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return ref.to_dict() Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:55:39.898466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application yield resource Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise self.value Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application session.commit() Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 23:55:39.899400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self.session.flush() Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application compat.raise_( Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 23:55:39.900240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:55:39.901098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application result.read() Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:55:39.901892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [parameters: {'id': '70b5698358604eb49fc6107238a072a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:39.902650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 22 23:55:39.905202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:39.907114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 177/359] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Oct 22 23:55:39 2022] POST /identity/v3/roles => generated 144 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:39.913065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:40.035299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025a904-7752-4ab3-a286-bffedcd0a41c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:40.083043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:40.083715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:40.083993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:40.084265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:40.100020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-784aa6b1-df36-44a6-8532-0185be7509af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:40.104837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:40.105702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:40.106517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 183/360] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:55:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:40.114022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:40.214994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:40.267429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ce87-11f9-48cc-8088-73b3abd08110 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:40.301729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:40.302612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:40.302884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:40.305065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:40.305737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:40.306034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:40.307430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa432-5803-449c-8eda-2539cd5c7baf None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:40.316626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 178/361] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:41.039396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70efda-a60d-4e81-b71a-0e13f574970b None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:41.039924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70efda-a60d-4e81-b71a-0e13f574970b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:41.039924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70efda-a60d-4e81-b71a-0e13f574970b None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:41.042117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 184/362] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:41.047257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:41.048021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:41.048486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:41.076324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:41.077820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:41.180740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 179/363] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:41.488981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70efda-a60d-4e81-b71a-0e13f574970b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:41.568751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:41.628285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70efda-a60d-4e81-b71a-0e13f574970b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:41.676699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:41.677601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:41.677877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:41.678142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:41.693693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:41.698505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:41.699386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:41.700189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:41.703183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 185/364] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:41.705855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:41.790037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:41.849856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c383f-4fa7-4021-9bd4-bacd98c51283 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:41.903928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:41.904570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:41.904846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:41.905113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:41.905791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:41.906095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:41.907542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce817d8-3e99-480c-84b5-55a49fb536ae None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:41.917288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 180/365] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:41.923000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:41.995364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6600-1eab-4346-b021-c2ef8f9406fa None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:41.995707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6600-1eab-4346-b021-c2ef8f9406fa None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:41.995927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6600-1eab-4346-b021-c2ef8f9406fa None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:41.997549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 181/366] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:42.002806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ab91-d1e0-46ec-9c74-5ac2fb3bd05f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.003237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ab91-d1e0-46ec-9c74-5ac2fb3bd05f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.003515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ab91-d1e0-46ec-9c74-5ac2fb3bd05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.027833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-26a3ab91-d1e0-46ec-9c74-5ac2fb3bd05f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:42.028456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-26a3ab91-d1e0-46ec-9c74-5ac2fb3bd05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:42.082563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f628fd-9e5d-410d-9666-5f387e1495b6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.105479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.114620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 182/367] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:42.123105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c2c1-dcac-4169-8fd1-24e87a3801c1 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.123105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c2c1-dcac-4169-8fd1-24e87a3801c1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.123105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c2c1-dcac-4169-8fd1-24e87a3801c1 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.123105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 183/368] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:42.130115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca64-3e63-406f-b0ad-c2628cab9364 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.130398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca64-3e63-406f-b0ad-c2628cab9364 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.130672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca64-3e63-406f-b0ad-c2628cab9364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.148800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.150780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.151064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.151363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.161815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-71b5ca64-3e63-406f-b0ad-c2628cab9364 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:42.163426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-71b5ca64-3e63-406f-b0ad-c2628cab9364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:42.165722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:42.168209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-250ffc7c-1c80-4a39-b8d4-56fce4f825b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:42.186845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:42.187771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:42.188595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:42.188595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:42.188595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:42.190833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 186/369] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:42.192922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2dfa7-cd96-4470-9375-7015fda42c28 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.193359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2dfa7-cd96-4470-9375-7015fda42c28 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.193782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2dfa7-cd96-4470-9375-7015fda42c28 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.196082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 187/370] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:42.196926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2dfa7-cd96-4470-9375-7015fda42c28 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.219463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.248227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 184/371] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:42.256850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.256996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.257306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.287948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:42.288895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:42.317254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2dfa7-cd96-4470-9375-7015fda42c28 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.356336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.357234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.357711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.358409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.359284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:42.359798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:42.361849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:42.374802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 188/372] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:42.379952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.415130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.424925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 185/373] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:42.425762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.486786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7410-230a-4201-92d8-ea2af19cf226 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.521371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.522428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.522918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.523417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.531326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:42.533661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:42.547363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:42.548266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:42.549267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:42.551825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 189/374] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:42.564063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.569168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e9e47-42b6-4621-948f-eb3ab1617b7b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.587750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.614044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.616009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.616288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.616622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.639452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:42.644956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:42.645812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:42.646661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 186/375] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:42.651807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.704728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.718382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eb0be-bf18-49a0-a249-b84170d00ccf None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.756778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.757335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.757612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.757885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.758611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:42.758915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:42.761179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:42.763275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91e75-69bd-46ec-b04f-ec0ce0b630c0 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.799390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 190/376] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:42.802372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.803522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.804335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.804616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.804891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.817786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:42.823183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:42.824230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:42.825171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 187/377] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:42.829687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.858438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.916682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc148-fd23-4759-b98e-5fb8f130cfba None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.934591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58086b-94bc-4755-9d05-b157375f9985 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:42.952618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.953227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.953506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.953783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.954446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:42.954753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:42.956690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:42.964688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 191/378] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:42.965295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:42.977170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:42.977385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:42.978086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:42.978509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:42.979206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:42.990369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:42.996430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:42.997323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:42.998130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 188/379] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:42.998861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.077538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d059-895d-4ad1-b4ff-482831f0a2d5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.090635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.107326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7bdd-f875-49b9-bfe3-35457e76171f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.116424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.117057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.117338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.117611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.130806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.132299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.144682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.145286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.145559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.145825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.146472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.146822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:43.147330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:43.148169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:43.148991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:43.148991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.148991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:43.149150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.149213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 192/380] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:43.149213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.162798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 189/381] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.163231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.221529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.260953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a7a7-8220-43d8-b481-5ac3893ebae1 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.264267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc90e-eae8-45bd-9421-80160985fb4a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.294558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.295216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.295493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.295761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.297986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.298580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.298905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.299215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.299869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.300165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.301514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.308008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.309423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.309558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 190/382] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.310318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.322626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:43.324584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:43.325502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:43.326326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:43.326326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.326326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:43.326326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 193/383] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:43.327018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.412917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f373c0-e620-4957-a903-aefcc5336d69 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.424307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183250df-bfc8-457f-8ba2-e010a261a17d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.437721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.446573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.447214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.447492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.447767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.448399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.448701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.450039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5b9a-7c3e-4118-99f6-29ea94a544bb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.458157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.458769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.459042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.459340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.461619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 191/384] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.462758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2420-53ad-4a20-911b-e7a2c5f8f068 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.463038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2420-53ad-4a20-911b-e7a2c5f8f068 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.463338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2420-53ad-4a20-911b-e7a2c5f8f068 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.464576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 192/385] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:43.465334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a2420-53ad-4a20-911b-e7a2c5f8f068 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.475496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.476868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:43.490636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:43.491679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:43.492505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:43.492505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.492505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:43.492505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:43.492505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.540388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.571421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a2420-53ad-4a20-911b-e7a2c5f8f068 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.597872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01003-cdfa-4267-b818-79144a1214c0 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.604654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.605273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.605546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.605814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.615510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.616931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.630335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.630929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.631241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:43.631388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:43.632441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:43.633292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:43.633292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:43.633292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:43.633453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.633453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.633453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.633626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 193/387] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:43.633626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.633752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64f36c-a7f0-4bec-852c-7fe4e893e6f0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.648506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 195/388] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.649747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.650030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.650298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.667853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:43.669059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:43.690340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.735727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:43.736488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.737858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513b161-8715-4445-bed2-6ed204d23f47 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.759550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.772090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.772709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.772982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.773249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.779676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.781098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:43.793190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:43.794056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:43.794895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 194/390] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:43.796062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.857443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847b45-5258-4f54-807e-13179ce21f13 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.891787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.892894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.893001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827acd7-9919-48cb-b9e1-00a12838499f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:43.893170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.893439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.894099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.894395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.895811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.907661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.908522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.927865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:43.931668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:43.932375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:43.932750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:43.933024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:43.933658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:43.933950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:43.935317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:43.949313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 195/392] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:43.950340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:43.996025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.020707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834532e6-f460-443c-aad5-54c12326ac0e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.053885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609048f2-6727-4866-88bb-5df92a518543 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.054908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.055568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.055846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.056123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.063469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.064963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:44.076105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.077141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.078327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.089787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.090401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.090677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.090948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.091662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:44.091964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.093375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.111222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 196/394] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:44.112402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.158643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.181826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6bbd-37cf-445d-bc80-e984044d1431 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.209806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688afa-103e-40cc-a5f6-06f9b4d249b9 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.211383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.215300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.215926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.216205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.216476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.224234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.225656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:44.236552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.237430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:44.238320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 199/395] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.238864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.249443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.250009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.250282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.250554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.258051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.259526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:44.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.272984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 197/396] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.273881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.345883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfecc40-90b1-4f7c-b13e-603edd73b9a3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.372151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eca01-1603-44d3-b6de-db496df6b322 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.379050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.379691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.379969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.380241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.383121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.391603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.393556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.406236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.406840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.407151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:44.407388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.408480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:44.409311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:44.409311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.409311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:44.409469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.409469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:44.409469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.409648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 200/397] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.409648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.409993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.448500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 198/398] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:44.449320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.470520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.511260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbb3f-7321-4917-8ce5-3ffc5e24facc None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.544712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.545359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.545639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.545914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.548077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385737-f6fc-47cc-bad2-baecf45cd602 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.560933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=81aba6d76ac940dcaa33247c65cc57b0, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.562366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.575795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 201/399] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:44 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:44.576590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.595947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.596755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.597030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.597323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.598055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:44.598358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.599896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.623896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.624991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 199/400] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:44.625959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.696714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565dc79-8de8-4ba0-8bb9-7ea53ce5b36f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.716211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.733743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.734286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.734570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.734850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.735634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:44.735947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.737494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.742418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a455d7-425e-467a-9bd5-d6b2fcc60412 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.756870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:44.757721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.783979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.784551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.784795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.785067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.785713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:44.786016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.787407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.805699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 200/402] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:44.805699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.851009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.860768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c474-940f-4faf-a92d-47d84466d15b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.896837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.897463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.897725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.897995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.909080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.910506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.920340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c694b6-df7e-4780-a5bb-73f19a1b5ce8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:44.925617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.926510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:44.928164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:44.928164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.928164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:44.931504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 203/403] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.932693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:44.957139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:44.957762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:44.958038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:44.958305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:44.965916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:44.971385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:44.973611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:44.988038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:44.988948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:44.989865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:44.989865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:44.989865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:44.989865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 201/404] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:44.990535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.049323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04588352-46b2-45bf-b406-67182560e1c5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.086078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.086695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.086971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.087269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.098656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.100112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.104417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a381ad-e31a-4627-930d-de2de16e37b7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.108402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:45.116491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:45.117391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:45.118295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:45.118295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:45.118295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:45.120209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 204/405] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:45.121204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.146747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.147688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.148052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.148363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.149005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.150427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.182436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 202/406] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:44 2022] POST /identity/v3/users => generated 247 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:55:45.191252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.245928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.250462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2f547-5679-47e5-88fe-6789ab11160b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.297782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc62866-1410-4e31-bf01-252312886886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.298856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62866-1410-4e31-bf01-252312886886 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.299424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62866-1410-4e31-bf01-252312886886 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.299891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc62866-1410-4e31-bf01-252312886886 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.300733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc62866-1410-4e31-bf01-252312886886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:45.301245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc62866-1410-4e31-bf01-252312886886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.303107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc62866-1410-4e31-bf01-252312886886 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.317576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 205/407] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:45.319855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be60f3-3bfc-480d-9015-cae41f51cceb None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.322632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc62866-1410-4e31-bf01-252312886886 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.376186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.377301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.377301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.377645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.378371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:45.378744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.380405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.395650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 203/408] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:45.396493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.400588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.449803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc62866-1410-4e31-bf01-252312886886 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.487825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.488480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.489218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.489218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.489659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:45.489964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.491431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.510361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 206/409] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:45.511518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.539945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42be76-0578-404a-b878-70b30611a05c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.550511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.586576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.587251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.587526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.587795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.597297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.598757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:45.613341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:45.614211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.615035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:45.619261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 204/410] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:45.620245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.645352 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f270f-90b9-45ef-ab55-89898b1f80c2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.670235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.689133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.690644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.691353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.692286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.701493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.703468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:45.717347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:45.718416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.719447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:45.722013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:45.723192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.739018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af5031-7cea-441f-b4d7-2fbd8621a075 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.779524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.780665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.781085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.781856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.791690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.794029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:45.809874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:45.810886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:45.811941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:45.819515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:45.819515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.845159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17dad7-d447-4d2b-9fc0-440afd939e7f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:45.864390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.881813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:45.882428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:45.882706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:45.882985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:45.883719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:45.884026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:45.885442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:45.904833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 208/413] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:45.905580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:45.950618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:45.963358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3030e-25a6-473e-8eeb-9b3dc14f1c1d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:46.010130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:46.011348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.012078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.012930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.014196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:46.014700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:46.015540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243e1a1-3fd5-4bad-828a-a09a6d62560b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:46.016577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:46.040076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 206/414] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:46.041179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:46.057190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:46.057793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.058082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.058351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.059042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:46.059410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:46.060892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:46.082183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 209/415] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:46.083045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:46.158982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:46.180760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6f60-6136-4b92-897a-205efa278c91 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:46.193745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:46.197165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa2885-5567-48f1-9e3a-5026999da890 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:46.232298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:46.233364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.233941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.234475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/1f1686221d7f4fdd942d96423204b366/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.236711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:46.237375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.237653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.237929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/587f9cc7c6714a718e19a10d1d6b6385/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.253335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=587f9cc7c6714a718e19a10d1d6b6385, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:46.254766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab39e-fbd3-467a-9e19-1ea985c1e2d1 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:46.255492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=1f1686221d7f4fdd942d96423204b366, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:46.258167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:46.272902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:46 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/1f1686221d7f4fdd942d96423204b366/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:46.273971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:46 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/587f9cc7c6714a718e19a10d1d6b6385/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:46.274345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:46.399391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca34b6-6f66-4275-a155-997548f172f8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:46.440979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:46.442029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.442513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.443057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/eeb59ec19c77483b9f6bea59189b22a6/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.447467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:46.462405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=eeb59ec19c77483b9f6bea59189b22a6, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:46.464355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb34ca-2804-48b4-be47-deee48961645 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:46.481326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 208/418] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:46 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/eeb59ec19c77483b9f6bea59189b22a6/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:46.940006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57895e08-3ddd-445d-98b0-a152f836c928 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.940419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57895e08-3ddd-445d-98b0-a152f836c928 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.940594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57895e08-3ddd-445d-98b0-a152f836c928 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.942172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 211/419] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:46.947302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:46.947592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:46.947868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:46.972091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:46.973325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:47.060768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 209/420] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:47.452214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef07d9-a72a-4a39-bff7-d3e5c9b82225 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:47.452719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef07d9-a72a-4a39-bff7-d3e5c9b82225 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:47.452824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef07d9-a72a-4a39-bff7-d3e5c9b82225 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:47.454542 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 212/421] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:47.470000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:47.473156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:47.473441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:47.473717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:47.499837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:47.501055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:47.646668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 213/422] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:47.676697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c428-b8ce-46fa-99bb-7152ce4fb0f1 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:47.715515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:47.730996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:47.731662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:47.731942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:47.732216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:47.747888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:47.755478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:47.756363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:47.757148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 210/423] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:47.762403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:47.876263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:47.904867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0adb06-6c80-449b-89eb-00bb83654afd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:47.922561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:47.968288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:47.968870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:47.969153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:47.969427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:47.970095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] RBAC: Adding query filter params (name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:47.970909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:47.972320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:47.992184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 214/424] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:47.997763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.082090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532244a-94cf-4693-a650-3a4b2fbbee0b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.120930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.121563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.121842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.122115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.133810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:48.139040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:48.139928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:48.140713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:48.148377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.195508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:48.245066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3da05-3418-4e9b-925c-6a9e01fb5205 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.271360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45767-d654-4599-b15d-96357ea2e82c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.308941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.309564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.309848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.310127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.310793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:48.311120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.312726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.326987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 212/426] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:48.328225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.372450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.373099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.373377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.373647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.400282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.401751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.403752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:48.438900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c171-4218-4041-be28-7d5e0da08593 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:48.440193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:48.441189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:48.442280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:48.442280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:48.442280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:48.442280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 215/427] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:48.452020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.467660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:48.482047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.483614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.484081 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.484674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.496650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.498385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:48.525870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:48.526935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:48.528055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:48.528055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:48.528055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:48.528055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:48.531802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.687738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeacf6-0ac0-4d8b-8a4b-19d7c4b1b4e6 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.709589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f827c9-4005-457e-8832-a5fd4a6f1ebc None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.762214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.762754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.763027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.763331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.763974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:48.764272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.765628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc786-fb67-4272-9582-3262dbf3ac31 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.776801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.777613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.777945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.778284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.778987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:48.779411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.780936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b763e-a5e1-4a8a-b138-82e279d91fa4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.781865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 214/429] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:48.783893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012826-cc94-4901-8fab-9420525d12d1 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.784374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012826-cc94-4901-8fab-9420525d12d1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.784837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012826-cc94-4901-8fab-9420525d12d1 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.786239 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 215/430] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:48.793636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012826-cc94-4901-8fab-9420525d12d1 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.800457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 216/431] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:48.801930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.802718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.803241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.812161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:48.826518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:48.827994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:48.883544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:48.911151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 217/432] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:48.912078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:48.926480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012826-cc94-4901-8fab-9420525d12d1 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:48.968946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:48.969936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:48.970467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:48.970934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:48.979393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:48.981835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:48.996368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:48.997309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:55:48.998218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:49.001156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 216/433] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:49.010380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.074501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ab8b-576e-427c-80b6-531c75bfb1bd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.110325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.111501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.111800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.112069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.119743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.121173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:49.133703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:49.134654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:49.135589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:49.140881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 218/434] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:55:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:49.140881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.150119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.186842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b738781-5a49-4a2e-bff1-5415cac06d6a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.191822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.234524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.235485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.235832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.236263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.237491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:49.238131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.239936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f9d0-15e7-4c68-8c6d-e052fc46efe4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.258338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad5569-88b8-442e-9ab1-43b46b261185 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.260444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 217/435] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:49.261659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb24-3dd7-40ca-9a9f-27e8aa089733 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.261942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb24-3dd7-40ca-9a9f-27e8aa089733 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.262213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb24-3dd7-40ca-9a9f-27e8aa089733 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.263567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 218/436] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:49.264160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7fb24-3dd7-40ca-9a9f-27e8aa089733 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.297827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.298436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.298738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.299015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.299772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:49.300077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.301505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736edd08-de0b-4dbd-9eb9-cc72b9555551 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.318902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 219/437] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:49.320166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26fdf-c316-4a60-8129-ec795b1ae8df None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.320521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26fdf-c316-4a60-8129-ec795b1ae8df None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.320793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26fdf-c316-4a60-8129-ec795b1ae8df None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.322000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 220/438] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:49.323000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.323355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.323733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.342183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:49.343425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:49.375230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7fb24-3dd7-40ca-9a9f-27e8aa089733 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.400999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.409481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.409613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 221/439] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:49.410114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.410335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.410431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.410643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.433232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:49.440511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:49.441548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:49.442365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 219/440] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:49.443029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.447805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.529170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b62dc-93ec-4003-ab06-bc4de1463d16 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.549334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7259-4dee-4a3f-a8df-5edea547f188 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.564907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.565534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.565811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.566079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.576239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.577676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.585600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.586198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.586470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.586736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-790c37e3-4413-4580-8b4f-9c53f2a43ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:49.593053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:49.593910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:49.594761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:49.594761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:49.594761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:49.594761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:49.595736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.596014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.596281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.614570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:49.615791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:49.649053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.663892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.665556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.681650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 223/442] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:49.682482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.697297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.776290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 220/443] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:49.776290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.789638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c255fb0-e87a-413a-8f91-e8b11af043d1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.825456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.826058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.826338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.826612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.827296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] RBAC: Adding query filter params (name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:49.827601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.828983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.841752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 224/444] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:49.841752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.867722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.883894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088040dc-daf9-4f86-bd7f-abc1fb9b7c08 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.921621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:49.922502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.923191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.923499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.924127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.924356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:49.924730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:49.925994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:49.937737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 221/445] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:49.938485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:49.951196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104305a-e2dc-4cfe-bae0-7e8ef299b497 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:49.984704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:49.985444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:49.985720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:49.986011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:49.996448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:50.001604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.002625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 225/446] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.003811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.041000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d0c0-4f0f-4af3-bcc6-b0594d3bb20e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.075336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.075952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.076225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.076489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.087242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.088655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.096765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.101703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453a210-f510-4f4a-8d1b-3e95b46b71af None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:50.103517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.104412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:50.105334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:50.105334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.105334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:50.105334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 222/447] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.105551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.136590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.137143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.137422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.137698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.140317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.150058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.151565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:50.165431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.166397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:50.171944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:50.171944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.171944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:50.171944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 226/448] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.171944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.206873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010c27-62d1-4ab5-af43-3367f1e4c0ee None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.239354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.239969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.240246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.240525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.246947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.248400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:50.259822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.260791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 223/449] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.266423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.266943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461911-05be-44c8-b989-86578876dd64 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.298749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.299498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.299780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.300052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.310172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:50.315462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.316394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:50.317183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 227/450] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.317851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.324593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.365735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f19d-47f2-4d5a-af77-dcffa0f5f534 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.366216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.401173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.401708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.401986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.402265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.402917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:50.403248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.404605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.412833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 224/451] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:50.413596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.418006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc5c8-e233-419f-97cc-c54e3d5d7dfb None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.451041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.451672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.451951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.452226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.452856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:50.453158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.454506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.466715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 228/452] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:50.467550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.517009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4ae9-d58e-4fb0-abb8-7f5936613139 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.540910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.553598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.554206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.554482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.554755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.555421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:50.555724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.557086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.563457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a914e-02b4-4221-a9e0-5d3c62c39104 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.569088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 225/453] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:50.569876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.574448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.599474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.600072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.600344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.600618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.601291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:50.601593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.602998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.614501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 229/454] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:50.615311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.668517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcdef0-104a-4b9d-8a6e-2ceb88b6a633 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.701874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.702471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.702746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.703027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.703700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:50.703993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.705874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.712808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026fa28-fd29-43c3-8c25-491987deed2c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.713464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 226/455] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:50.714229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.749532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.750151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.750426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.750695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.758472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.762501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.765065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:50.788357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.789318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:50.790601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:50.790601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:50.790601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:50.790601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 230/456] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.791307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.813784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:50.828293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc28a-1d14-4094-9721-7a7bb7e12119 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.861493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a96756-1765-4859-a751-37802844dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.862112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a96756-1765-4859-a751-37802844dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.862485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a96756-1765-4859-a751-37802844dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.862757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a96756-1765-4859-a751-37802844dd3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.869186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a96756-1765-4859-a751-37802844dd3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.870594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a96756-1765-4859-a751-37802844dd3c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-60a96756-1765-4859-a751-37802844dd3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:50.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.882914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:50.883824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 227/457] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.884271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a96756-1765-4859-a751-37802844dd3c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.893118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e671043-877f-49cd-94fc-c962e1c3f52f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.924978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:50.925529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:50.925807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:50.926080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:50.933540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:50.934959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:50.946435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:50.947471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 231/458] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:50.948804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:50.983823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a96756-1765-4859-a751-37802844dd3c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:50.986649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.017182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.017833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.018114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.018387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/318a76b9d85747f5ae83df6d6b497131/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.026994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.032774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=318a76b9d85747f5ae83df6d6b497131, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.035196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.046668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:50 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/318a76b9d85747f5ae83df6d6b497131/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:51.046811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9e9f-670f-4364-93df-1813ee852518 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.047831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.084511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.085162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.085441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.085725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.098287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.099814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:51.115796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:51.116770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:51.117617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:51.117617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:51.117617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:51.117617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 232/460] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:51.118366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.172477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c024-282e-40ef-ae7d-f6ee33e80e47 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.210980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.211537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.211816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.212083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.212723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:51.213020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.214630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.229867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 229/461] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:51.230701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.238718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330278-677f-462b-b6ca-cff8000f1136 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.250607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.275835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.282577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.283741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.284027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.284558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.285257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:51.285671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.287305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.305898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 233/462] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:51.306800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.345290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2850-e125-4da7-a1a5-676677f7fcaa None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.382106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.382819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.383124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.383404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.384246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:51.384555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.386122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.409534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 230/463] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:51.409534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.412604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956dba-f2be-43ca-b1bc-20d833966c5f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.449728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.450341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.450813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.451043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.451753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:51.452202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.453519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.472532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 234/464] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:51.472532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.485822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.526136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561c47-6967-46d1-98ea-d2a229847f0d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.528598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.561681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.562314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.562596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.562858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.570949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.572413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.579024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e375-7525-4617-81b2-a7aea190338e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:51.584118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:51.584979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 231/465] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:51.590445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.619893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.620490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.620764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.621034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.621747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=81aba6d76ac940dcaa33247c65cc57b0) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:51.622052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.623490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.635106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 235/466] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/role_assignments?user.id=81aba6d76ac940dcaa33247c65cc57b0&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:51.635106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.707998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897b4ef-753d-4539-9bf9-ac99762b7a6f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.741463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.749200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.750282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.750753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.751345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.762244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405c32-bf7b-4d88-ab45-8d79a4061086 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.781117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:51.801361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:51.801990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:51.802578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:51.802856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:51.811621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.813146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:51.826970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:51.827974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 22 23:55:51.828843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:51.833023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 236/467] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:51.834010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:51.839121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:51.840856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:51.960792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d969d-e5af-412f-9abe-3df08f30732c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:51.975678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 232/468] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:51.975678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.005208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.005992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.006750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.007339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.007809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.009075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:52.009594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.012147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.033534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 237/469] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:52.034750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.072577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.085456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9d554-ffb5-4dff-b70d-26bf919b119a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.121700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.122384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.122664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.122935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.123784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:52.124035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.125586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.144210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Oct 22 23:55:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:52.145117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.152886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464051-c3fb-48e1-a2fd-df514518a939 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.193837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.195214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.195701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.196401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.208103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.209933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:52.227962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:52.229447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:52.230454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:52.230454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.230454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:52.236861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 238/471] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:52.238208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.243462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.259371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1ed1-3587-411b-b733-6d8b5fb5adb4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.307260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.308391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.309253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.309928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.339263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.356466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d238bd-66d2-4acc-9d6b-034d150fd135 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.392238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.392844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.393123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.393393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.405456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.407580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.468864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.470855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.518711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.532283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 234/472] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:52.534058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.558064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.576586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 239/473] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 23:55:52.577418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.646897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2d56-f81d-4c97-a42c-355aac686cd4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.682295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e44a1-a4eb-4b67-8cf9-70b6063822d3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.685669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.686499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.687002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.687492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.688319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:52.688834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.690554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.707326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 235/474] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:52.708524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.717677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.718306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.718582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.718852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.729294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.730842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:52.746334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:52.747263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:52.748098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:52.748098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.748098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:52.748098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 240/475] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:52.748719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.768140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.790384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:52.827159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620dc1a-bb9a-4635-82b2-29d02bc2f8bd None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.853234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815daf0-e4b1-479b-907f-4e2598f19eeb None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:52.865339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.866272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.866739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.867227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.879180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.880934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.889527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:52.890418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:52.890534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:52.890838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:52.897787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:52.898656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:52.899525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:52.899525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:52.899525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:52.899681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:52.900676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:52.902059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 236/476] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:52.903136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:52.913162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:52.914024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:52.914852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 241/477] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:52.915335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.015696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b34e3b-1d3d-4c0e-8d18-dfcd0ad2cf92 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.017293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.018025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.021276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76484-40d2-464c-9a82-c566ab84cb4c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.054968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.055876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.056324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.056764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.057726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.058288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.059950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.060053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.060683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.061028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.061368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.062064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.062462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.063979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.074511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 237/478] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.075600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.079977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 242/479] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.080929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.184588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd82c-cdf0-4d32-9c80-52425a536c06 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.194481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573706-d0e0-4406-acfb-1c8dc5aef265 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.220907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.221787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.222262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.222741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.223673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.224166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.225755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.230607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.231313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.231597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.231871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.239100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.239919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 238/480] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.240929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.243576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-1ad7aca3-f486-48da-b3a9-6cd4467baad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:53.256056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:53.256895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:53.257720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:53.258704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 243/481] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:53.260126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29128-0a77-4ecd-8053-c99a4add996a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.260600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29128-0a77-4ecd-8053-c99a4add996a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.261078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29128-0a77-4ecd-8053-c99a4add996a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.262636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 244/482] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:53.263639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29128-0a77-4ecd-8053-c99a4add996a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.266512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.285582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.343888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979e613-f2b4-4388-bf2c-8b38404602b8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.375038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29128-0a77-4ecd-8053-c99a4add996a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.376376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.377052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.377324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.377589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.384074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.385495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:53.397092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:53.398082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:53.399131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:53.402826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 239/483] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:53.403729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.413264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.414000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.414445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.414813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.415772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=587f9cc7c6714a718e19a10d1d6b6385) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.416177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.417677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3fe9d-266b-443e-afe5-7e556a1e4096 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.435278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 245/484] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/role_assignments?user.id=587f9cc7c6714a718e19a10d1d6b6385&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.436835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.437247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.437623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.457718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:53.459130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:53.529263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.540286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 246/485] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:53.541289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.555754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14ba9-3578-4b00-b5b8-f47e17ce1e6b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.557427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.631643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.633560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.633978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.636116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.636984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.637435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.640500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.660144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 240/486] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.666624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.697119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4c90c-6579-4520-baef-9f8d8aca16ee None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.735771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.736522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.736800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.737072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.737897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.738212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.739784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.755105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 247/487] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.759605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.794898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc266d6-00d6-45d7-acf2-26b05bfed280 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.835819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.838712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.839409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.839884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.840882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=1f1686221d7f4fdd942d96423204b366) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.841394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.843123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.851036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 241/488] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/role_assignments?user.id=1f1686221d7f4fdd942d96423204b366&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.858882 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.868184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:53.883885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:53.898028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d233fc1-fa60-4b4f-b80f-87be7b12a0df None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:53.938747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:53.939925 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.940612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.940895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.941648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=eeb59ec19c77483b9f6bea59189b22a6) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:53.941941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:53.943426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8688157-745d-42a7-abe5-f529293ce0a7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:53.950945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 248/489] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/role_assignments?user.id=eeb59ec19c77483b9f6bea59189b22a6&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:53.970892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7d28-23a9-4198-a217-3bc2f5154255 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.971219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7d28-23a9-4198-a217-3bc2f5154255 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.971493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7d28-23a9-4198-a217-3bc2f5154255 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:53.972828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 249/490] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:55:53.978690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:53.978971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:53.979295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.021568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:54.022877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:54.121986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e247a-583e-421f-b990-6fd21c6e3014 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.154045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 250/491] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:55:54.164931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.165568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.165846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.166118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.177770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:54.183059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:54.183988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:54.184762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 242/492] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:54.190067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.269201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:54.309811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c08b-0349-4059-9234-aa22fbbf459f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.346620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.347276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.347605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.347884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.348544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] RBAC: Adding query filter params (name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:54.348844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:54.350200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:54.359147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 251/493] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:55:54.366058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.434920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.480157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:54.552306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7440d-bc5f-4203-b5fd-b9ecd8c418ec None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.596623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5f31-ede7-43a6-b0eb-181e8f25f552 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.614207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.615285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.615761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.616227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.639434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:54.641288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:54.652430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:54.668812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.669473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.669762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.670041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:54.673002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:54.674775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:54.675844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:54.675844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:54.675844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:54.683245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 243/494] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:54.684419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.689600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:55:54.696246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:54.697197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:55:54.697994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:54.703110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 252/495] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:54.720047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.796493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a5380-66af-44da-be62-b17a85d2a391 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.818439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:54.834719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.835358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.835641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.835911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.836888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:54.837743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:54.839153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:54.852915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 244/496] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:54.864080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:54.956543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b137f2-d291-46f8-bcc1-15d01696b9d7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:54.990664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:54.991333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:54.992406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:54.992683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:54.993343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:54.993645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:54.994996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.008694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 253/497] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:55.014132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.082022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e3a4-9821-415b-b230-54dd0ffac769 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.119559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.121412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.121695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.121968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.127435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:55.139623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.143325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:55.174805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:55.175910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:55.177494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 245/498] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:55:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:55.185312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.227090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba158b-2440-4747-9f66-eb9744c5fa8a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.259419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:55.293685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.294373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.294654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.294926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.315174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.316603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:55.346351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:55.347354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:55.349042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:55.349042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:55.349042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:55.349042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 254/499] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:55:55.353036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.384006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b74db-c39e-4573-ae17-d5f65aa309c4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.446234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.446846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.447173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.447452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.448177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:55.448476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.449901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.485331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 246/500] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:55.491843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.529030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763ff5-a57a-47bd-818e-4ab49063261e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.534159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:55.589320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.589919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.590198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.590465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.591131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:55.591439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.592796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.622682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 255/501] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:55.623631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.659445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:55.668612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99532d5-40e9-41f3-903b-1adedd3cb669 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.731477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.732106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.732350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.732618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.812766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.814325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.824725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483ccd2-cd6b-4663-9add-139050af00ab None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:55.912477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:55.913179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:55.913461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:55.913738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:55.933719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:55.935203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:55.948813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:55:55.954348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:55.955366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:55.956308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 256/502] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:55.961813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.978649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 247/503] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 22 23:55:55.986234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:55.999455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.149407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd9a4-9a0e-4cda-97bb-e1100655633b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.158362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e6657-989c-4052-9726-7989a08bd1ed None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.185201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.185808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.186082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.186355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.187089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:56.187401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.188824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b7fcb-aca3-43e7-a730-286f5128dccf None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.196070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.196705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.196981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.197361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.207054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 257/504] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:56.208380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3f64-273b-4245-b61b-f882807fe671 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.208669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3f64-273b-4245-b61b-f882807fe671 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.208946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3f64-273b-4245-b61b-f882807fe671 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.210446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 258/505] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:56.212574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3f64-273b-4245-b61b-f882807fe671 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.213705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.215643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-9ae22b49-5836-4067-aaf4-81b2d92a54c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:56.235662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:56.236750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:56.237660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:56.237660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:56.237660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:56.237660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 248/506] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:56.239264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.239264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.239264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.268368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:56.269558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:56.330160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.333533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.362571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3f64-273b-4245-b61b-f882807fe671 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.362778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 249/507] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:56.363756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.417149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.417702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.417981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.418251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.440914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.443550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-2166f6a1-3ee0-4e1c-8a0e-f386e67a5b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:56.464652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:56.465656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:56.466554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:56.466554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:56.466554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:56.473136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 259/508] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:56.473136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a70ec-44e6-420a-96a1-9e83f27b2d8b None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.473414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a70ec-44e6-420a-96a1-9e83f27b2d8b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.473484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a70ec-44e6-420a-96a1-9e83f27b2d8b None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.474979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 260/509] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:56.476946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a70ec-44e6-420a-96a1-9e83f27b2d8b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.513136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd9609-26bc-44f2-9261-fb1006e02fcf None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.551335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.551915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.552426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.552698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.553331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:56.553627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.554984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f2c9-4b71-458b-9850-1c9c12793156 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.571367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 250/510] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:56.572709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.572995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.573270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.592723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:56.593952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:56.622227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a70ec-44e6-420a-96a1-9e83f27b2d8b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.624933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.655096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.661190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.661805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.662085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.662359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.662994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:56.663223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 251/511] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:56.663367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.664051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.664758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150949e-302a-47b1-94de-261f3d6ea3e6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.678861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 261/512] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:56.680154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc509a5-31fb-44d0-b7fc-4f6033310f4c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.680445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc509a5-31fb-44d0-b7fc-4f6033310f4c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.680768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc509a5-31fb-44d0-b7fc-4f6033310f4c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.685885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 262/513] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:56.685885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc509a5-31fb-44d0-b7fc-4f6033310f4c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.775536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b25a-def9-4fec-8b00-155267aea4bd None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.789936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc509a5-31fb-44d0-b7fc-4f6033310f4c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.811971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.812598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.812877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.813150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.820930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.822360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.825819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.826427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.826704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.826977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.827561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.828882 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:56.833936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:56.834791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 252/514] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:56.836291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-a224dc2c-97da-4145-b311-dcbd26908389 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:56.839754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:56.841265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:56.842830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 263/515] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:56.843721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.843721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.843721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.860358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:56.862093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:56.874471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.918843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:56.937353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 264/516] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:55:56.938602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:56.949856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0d6c0-5fe2-4563-936d-82a32e605b2e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:56.986583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:56.987257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:56.987666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:56.987900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:56.995308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:56.996880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:55:57.009396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:57.010237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 253/517] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:57.011510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.048098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3356e-a736-4ebf-8315-895429af9413 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.082622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.083262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.083558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.083820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.084504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.084811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.086220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.097739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 265/518] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.098523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.110084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.124353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dcded-6f7d-4aed-8966-5be9e3da665e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.149018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.160642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.161246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.161521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.161789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.162405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.162701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.164083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.168371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 254/519] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.169143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.214044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eddac-67a2-41d1-a0de-36c7cc710e54 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.247479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.248102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.248381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.248650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] PATH_INFO: `/v3/services/network` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.249218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.250573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:57.259160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:57.260296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:57.261682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 266/520] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:57.265610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.267711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2502-ccc2-430d-9e3a-f8577e0e9d34 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.301117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.301717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.302009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.302524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.303236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.303542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.304951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.316893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 255/521] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.317659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.333906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.365901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7e294-197e-4c48-bbdf-84aeaa05299f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.375949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.400296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.400897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.401175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.401447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.402162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=318a76b9d85747f5ae83df6d6b497131) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.402470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.403978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.409664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 267/522] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/role_assignments?user.id=318a76b9d85747f5ae83df6d6b497131&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.410429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.426891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d3dd-3ef3-4c49-a9d0-c78eeb38984b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.470355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.471030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.471338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.471619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.472266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.472575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.474075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.491108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 256/523] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.491108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.541007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9922582-cb55-40e2-96f5-857c9eedd73d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.582002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.582938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.583338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.583713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.591525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.598857 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.600359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:55:57.619431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:55:57.620460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:55:57.621334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:55:57.621334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:55:57.621334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:55:57.621334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 268/524] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:55:57.621552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.628682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc51a-b0bc-40bb-843b-a8797d3601b8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.665986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.673838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.674477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.674759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.675035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.675897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] RBAC: Adding query filter params (name=network) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.676211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.678018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.684872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 257/525] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.685730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.757342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2169-93f2-4401-9025-36f3db9cc146 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.794143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.794793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.795067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.795365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.797471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=81aba6d76ac940dcaa33247c65cc57b0, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.798960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.815849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 269/526] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:55:57 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:55:57.816776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:57.828222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf7a-4f1d-41cf-af0d-722240aefe3d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:57.908843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:57.909474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:57.909802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:57.910074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:57.910788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:57.911102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:57.914220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:57.935278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:57.942453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 258/527] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:57.949408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:55:58.000540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:55:58.031427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076296-d64d-4d68-aced-6f80983493a9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:58.078597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:58.079372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:58.080143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:58.080848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:58.081493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] RBAC: Adding query filter params (type=network) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:55:58.081801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:58.083910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a42ee-53c3-4a61-968b-8877e68774be None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:58.095216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 270/528] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:55:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:55:58.115621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788b55-aa19-4e91-813f-862000cc7971 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:55:58.156341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:55:58.157282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:58.157753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:58.157969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:58.158831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:55:58.160596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5aac8-ed76-4960-8821-b51b2dd2f4df None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:55:58.184788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 259/529] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:55:57 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:55:59.919848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b7c0-942e-4bf9-8a66-feeda323cd88 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:59.920402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b7c0-942e-4bf9-8a66-feeda323cd88 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:59.920402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b7c0-942e-4bf9-8a66-feeda323cd88 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:59.921934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 271/530] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:55:59.928084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:59.928475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:59.928662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:59.956151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:55:59.957397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:55:59.993095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c86b-dbcb-44da-8474-60c61f583377 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:55:59.993416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c86b-dbcb-44da-8474-60c61f583377 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:55:59.993690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c86b-dbcb-44da-8474-60c61f583377 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:55:59.995447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 272/531] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:00.000384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.000660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.000932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.019901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:00.021091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:00.047422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:00.076692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 260/532] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:56:00.105848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 273/533] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:56:00.378873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:00.501178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a113cb-e407-4f0c-a463-7162f661ebf2 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:00.502820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:00.549901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:00.550531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.550811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.551109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.551783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:00.553418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe4f5-88be-4453-b3cc-3fe96c375da8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:00.573470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 261/534] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:00 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:00.629039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:00.659951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb717605-7b98-45d0-98c4-32059be191cf None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:00.691439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339721-ed45-4584-a9df-31180b479148 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.691801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339721-ed45-4584-a9df-31180b479148 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.692146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339721-ed45-4584-a9df-31180b479148 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.693707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 262/535] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:00.703058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.703058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.703058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.721397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:00.722674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:00.729989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:00.730915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.731406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.731680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.756046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:00.762614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:00.763642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:00.764520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:00.769229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 274/536] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:00.775851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:00.836571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:00.838943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 263/537] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:56:00.934637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbde9b-781e-45e2-a23a-4ce207fe0441 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:00.977628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:00.978249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:00.978528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:00.978801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:00.979498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:00.979802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:00.981182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3384-2629-46ce-98d0-b850c65a0707 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:00.983749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:00.992931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 275/538] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:00.998263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.020323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd8dd-7fc1-4599-ab73-77dfe10431ff None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.020633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd8dd-7fc1-4599-ab73-77dfe10431ff None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.020873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd8dd-7fc1-4599-ab73-77dfe10431ff None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.022407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 276/539] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:01.027632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a6c0-64a7-4fac-ae2a-03bc7268378f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.027913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a6c0-64a7-4fac-ae2a-03bc7268378f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.028184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1a6c0-64a7-4fac-ae2a-03bc7268378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.049817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9be1a6c0-64a7-4fac-ae2a-03bc7268378f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:01.051021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9be1a6c0-64a7-4fac-ae2a-03bc7268378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:01.121480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c2e3-4b1e-43f8-af47-6b8d207af1e9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.139184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 277/540] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 23:56:01.140794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f58-7280-42c3-b625-f378c8b91c9c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.141307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f58-7280-42c3-b625-f378c8b91c9c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.141784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f58-7280-42c3-b625-f378c8b91c9c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.146926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 278/541] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:01.151040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.151565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.152046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.165927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.166676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.166954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.167258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.179279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:01.180176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:01.181025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:01.181618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:01.201777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:01.202733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:01.204303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:01.204303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:01.204303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:01.207135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 264/542] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:01.208266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.247431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.267251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 279/543] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 23:56:01.268324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.332902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b600e-4e45-464a-ae58-ca0f7a4a3059 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.371370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.372677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.373133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.373577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.386529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:01.387938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:01.394801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:01.395871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:01.396690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:01.399460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 265/544] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:01.407129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.454591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd8e36-86e5-4612-80d1-732d1c9dc681 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.492167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.492775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.493054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.493329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.493965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:01.494266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:01.495650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:01.508285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 280/545] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:01.508998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.528428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.546210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15f3bc-e9fa-4a8f-9006-9889fa4ea712 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.595719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.596334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.596614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.596886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.597554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:01.597858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:01.599233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:01.611430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 266/546] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:01.611430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.628054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc679d-a67a-4b58-8766-cc8c4654266b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.645085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.662690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.663344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.663622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.663960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.664591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:01.665969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:01.683132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 281/547] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:01 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:01.683893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.730921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18def-69ce-4feb-bb9b-6faade84c52d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.781433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.782078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.782356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.783288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.792493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:01.795090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:01.811616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:01.812646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:56:01.813583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:01.814574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 267/548] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:01.814574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.831402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.846259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36604-e591-4cd0-afb8-40945e428f62 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.903920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.904560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.904839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.905114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:01.921342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:01.926981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:01.928191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:01.929060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 282/549] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:01.930208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:01.950603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7cc07-7755-48c2-93d4-4b40f359f79e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:01.983280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:01.998774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:01.999475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:01.999716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:01.999992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.015224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.017006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:02.036833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:02.037829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:02.038694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:02.038694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.038694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:02.038694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 268/550] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:02.038694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.065350 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9410fb-003a-4dad-8c0b-3c933fc08b5e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.101156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.101766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.102057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.102326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.103057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.103419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.104871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.105997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.123342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 283/551] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:56:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.124178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.154856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2fbff-9ca9-41ac-b674-947f34f828a5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.194165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.194824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.195128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.195401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.196052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.196349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.197905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.207026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 269/552] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.207865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.227683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.233588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11b3c7-e3f3-45b0-829e-bef9755f6360 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.269567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.270177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.270516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.270728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.271480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.271986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.273133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.289806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 284/553] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.290705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.327165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9ad5-6ed8-42ee-a11d-0ef119ff5342 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.353299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.376439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.377386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.378282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.379002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.393999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.395472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.405301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4362ef-9d37-48c9-b4cd-9ff8d636db0a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:02.410338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:02.411288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:02.412175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:02.412175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.412175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:02.416115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 270/554] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:02.417028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.452484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.455149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.455640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.456109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.470571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.472386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:02.495836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:02.496794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:02.497676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:02.497676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:02.497676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:02.500260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 285/555] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:02.501374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.516842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.537299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081b24-03c3-49f5-9f20-30a73b0b662c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.574927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.575812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.576145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.576421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.585345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.586975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:02.599204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:02.600210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:02.601147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:02.605034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 271/556] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:02.606101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.642027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.644460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a9c8-4421-4a41-b10d-1eaa9fb20a44 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.690303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.691336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.691818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.692289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.693117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.694025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.696013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.711511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 286/557] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.712682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.725287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979fc3-0844-4a1e-8eb3-cfd251f54189 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.770230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.771253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.771735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.772639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.773776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.774281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.776751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.786828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.793888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 272/558] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.794997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.829434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35507e-2201-448a-a721-c0ce82e08e7b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.866521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.867344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.867629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.867952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.868670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:02.868980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.870399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:02.894046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 287/559] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:02.894597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:02.918818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:02.932042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbbc1-b247-48fd-9657-d642c6b0abff None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:02.977551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479118bb-e43d-4458-963f-958022cda657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:02.979064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479118bb-e43d-4458-963f-958022cda657 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:02.979574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479118bb-e43d-4458-963f-958022cda657 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:02.980044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479118bb-e43d-4458-963f-958022cda657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:02.990175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479118bb-e43d-4458-963f-958022cda657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:02.991860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479118bb-e43d-4458-963f-958022cda657 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.005405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbbcc2-c741-4ac0-ac05-2b18d5b3996c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-479118bb-e43d-4458-963f-958022cda657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:03.009410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:03.010565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:03.011468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:03.014370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 273/560] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:03.015384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479118bb-e43d-4458-963f-958022cda657 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.039880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.051784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.052926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.053280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.053681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.062968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.064718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:03.083591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:03.084612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:03.085534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 288/561] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:56:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:03.086123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.161765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479118bb-e43d-4458-963f-958022cda657 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.194574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2aff-282d-40d2-a4fe-cc211a5f1e1b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.198863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755638df-7f41-4756-a757-802f7c040cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.199496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638df-7f41-4756-a757-802f7c040cda None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.199773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638df-7f41-4756-a757-802f7c040cda None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.200046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638df-7f41-4756-a757-802f7c040cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.222771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.236768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.238160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.238454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.238758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.239483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:03.239790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.241324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.259363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 289/562] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:03.259363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.273880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755638df-7f41-4756-a757-802f7c040cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.275399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755638df-7f41-4756-a757-802f7c040cda None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.310216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.366835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f07b3-2775-4706-a7ec-585d262cd317 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 274/563] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8d91-7e1b-4d90-b718-bf22ae54f82d None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8d91-7e1b-4d90-b718-bf22ae54f82d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8d91-7e1b-4d90-b718-bf22ae54f82d None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 275/564] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:03.384739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8d91-7e1b-4d90-b718-bf22ae54f82d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.410826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.411478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.411755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.412012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.412733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:03.413042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.414475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.436786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 290/565] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:03.436786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.441413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.493966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8d91-7e1b-4d90-b718-bf22ae54f82d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.536553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.538021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.538484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.539110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/318a76b9d85747f5ae83df6d6b497131/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.541921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=318a76b9d85747f5ae83df6d6b497131, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.544188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787744f-7b0d-447d-a1e3-19eb85cbc429 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.545172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec22bd-77fd-4f47-937a-41ec9ab3a5b7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.547494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.561961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 276/566] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:03 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/318a76b9d85747f5ae83df6d6b497131/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:03.563155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.563513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.564297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.587308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:03.589310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:03.597828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.598983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.599552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.600112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.614679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.616636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:03.636786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:03.637808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:03.638679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:03.638679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:03.638679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:03.641043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 291/567] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:03.642260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.689295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 277/568] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:03.690330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.746496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.770438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d59b2-9e4c-4a2d-b70d-84787f5acdc9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.815632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.816192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.816471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.816741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.834760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.836302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.842235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1c9f6-4482-4bbd-97e9-2f1ccd517a3f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:03.853427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:03.854434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:03.855381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:03.855381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:03.855381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:03.855381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 292/569] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:03.861279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:03.880812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:03.908642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:03.909268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:03.909546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:03.909815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:03.910456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:03.910754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:03.913546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:03.938982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 278/570] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:03.947705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.021247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3dead-ed57-4457-9b56-965122165ae4 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.060280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.060884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.061264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.061534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.062277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.062576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.064611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d215f9-ad67-4238-b7ff-0f16d0e0dbfd None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.068432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d205e-a8b1-459c-93f2-4de9b4284a8a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.069889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.079539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 293/571] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.079539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9fa51-28ff-4f05-9f00-3a8b238384db None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.079539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9fa51-28ff-4f05-9f00-3a8b238384db None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.079854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9fa51-28ff-4f05-9f00-3a8b238384db None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.085005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 294/572] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:04.085761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9fa51-28ff-4f05-9f00-3a8b238384db None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.108531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.109166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.109443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.109721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.117123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.118559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:04.129804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:04.130746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:04.131656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 279/573] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:04.132133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.162779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.201386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9fa51-28ff-4f05-9f00-3a8b238384db None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.239065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.239709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.239998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.240270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.240851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.242247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.243655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4dd43-5658-4155-a5ca-52a33a3f469e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e4e1f1b7-e0da-4fe0-bca5-3b1b046bf127 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:04.251868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:04.252833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:04.253684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.257871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 295/574] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:04.259122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.259407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.259686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.278029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:04.279299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:04.280973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.281599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.281873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.282145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.288931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.290331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:04.301420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:04.302643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 280/575] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:04.303666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.330940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.355714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 296/576] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:04.356548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.413378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5b52a-c8b8-4860-97d0-2cdeb7bb5f8c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.439730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.451552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.452192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.452470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.452740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.453424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.453725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.455750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.472669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 281/577] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.472669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.494405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c61735-2065-455c-8f91-1772f40796b4 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.542131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.543058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.543612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.544085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.544903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.545425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.546971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.557473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 297/578] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.558586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.561101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.583161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41d79c-4a49-4873-b875-33ae1a2f20ae None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.619429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.620040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.620320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.620594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.621280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.621584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.623280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.634900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 282/579] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.635728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.675467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c734-934e-463f-8fca-b642099cb6ec None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.704154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.714357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.715249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.715738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.716318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.717037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=81aba6d76ac940dcaa33247c65cc57b0) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.717342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.718858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.731271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 298/580] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/role_assignments?user.id=81aba6d76ac940dcaa33247c65cc57b0&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.732577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.737675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f7190-d092-41ad-83a6-7998ca47d742 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.777987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.778635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.778896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.779202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.779846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:04.780152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.781594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.788044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 283/581] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:04.789047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.807506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:04.855279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043c7e-0f31-46d7-8e5e-52a4ee34554f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.902576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.903252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.903533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.903810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] PATH_INFO: `/v3/services/network` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.904660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.906443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:04.918091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:04.919495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:04.920401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 299/582] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:04.921213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:04.925350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eec4-a794-4f0e-8588-a8642b61f6c3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:04.962395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:04.963060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:04.963366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:04.963641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/b117c6096699423e861914df7f150e43/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:04.981682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=b117c6096699423e861914df7f150e43, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:04.982658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:04.984571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:05.005000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 284/583] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:04 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/b117c6096699423e861914df7f150e43/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:05.006044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:05.071772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edf5d-abbe-4bfd-bacd-6a841496feef None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.128403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:05.150037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.150718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.150998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.151398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.151999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] RBAC: Adding query filter params (interface=public, service_id=58882cf7cf0841a09516022da918f09e, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:05.152309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.153667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.162940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 300/584] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:04 2022] GET /identity/v3/endpoints?service_id=58882cf7cf0841a09516022da918f09e&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:05.172720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:05.211445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebcc21-06ca-479b-a60e-76909e8a44dc None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.263155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366722-726c-4001-8569-a914a955be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.264165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366722-726c-4001-8569-a914a955be1c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.264582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366722-726c-4001-8569-a914a955be1c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.264987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366722-726c-4001-8569-a914a955be1c None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.266094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366722-726c-4001-8569-a914a955be1c None admin] RBAC: Adding query filter params (name=network) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:05.266746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366722-726c-4001-8569-a914a955be1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.268768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366722-726c-4001-8569-a914a955be1c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.275225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 285/585] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:05.280858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366722-726c-4001-8569-a914a955be1c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:05.327410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc985-b410-40cc-9bcc-1f3127208ee2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.364227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:05.401755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.402588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.403008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.403462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.404249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.405803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.418786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 301/586] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:05 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:05.421315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366722-726c-4001-8569-a914a955be1c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.445918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:05.462262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.462879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.463186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.463458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.464094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] RBAC: Adding query filter params (type=network) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:05.464395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.465790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.472117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 286/587] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:05.478058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:05.633110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e9f9-5ccd-4028-a681-86f4b987f012 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.668875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.669804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.670301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.670764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.671695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] RBAC: Adding query filter params (interface=public, service_id=a542da23239240c5a41a9b0160f66c90, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:05.672199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.673778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c574d2-5fc4-41aa-bf5e-2373d8c578bb None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.679838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 302/588] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:05 2022] GET /identity/v3/endpoints?service_id=a542da23239240c5a41a9b0160f66c90&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:05.685612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:05.801231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a1e-50af-4b50-a0c6-043aa9a5291d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:05.850517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:05.851596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.852085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.852547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.853357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:05.854910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297ade6-c469-44fa-9486-abc886f85662 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:05.861492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 287/589] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:05 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:05.990059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92628246-1039-425b-8b9d-995aab9b14dc None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:05.990662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92628246-1039-425b-8b9d-995aab9b14dc None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:05.991181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92628246-1039-425b-8b9d-995aab9b14dc None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:05.992957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 303/590] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:06.013753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:06.014367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:06.014855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:06.044305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:06.045917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:06.114188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:06.140427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 288/591] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:06.444196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92628246-1039-425b-8b9d-995aab9b14dc None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:06.500735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:06.587777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92628246-1039-425b-8b9d-995aab9b14dc None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:06.633164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:06.633803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:06.634082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:06.634351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:06.648538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:06.653667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:06.654579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:06.655437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:06.658195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 304/592] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:06.664077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:06.813922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ca5ac-734c-4cae-98fc-45c6c879ec51 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:06.864457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:06.865072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:06.865346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:06.865614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:06.866268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:06.866624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:06.868006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:06.883961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 289/593] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:06.889972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:07.039891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052749-10c1-4949-9537-015cf27d27d8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:07.052666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:07.085481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:07.086125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.086401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.086678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.103045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:07.104524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:07.123953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:07.125109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:07.126008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:07.126008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:07.126008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:07.126008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 305/594] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:07.131165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:07.194639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:07.286249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa2e11-a5b5-4157-81b2-743f57be12cd None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:07.323364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:07.323992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.324271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.324546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.325195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:07.325500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:07.326869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03665ee-7a82-442c-9c5d-f9e30557d7b8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:07.340307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 290/595] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:07.348420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:07.442828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a6a1-2697-4585-85ba-baac98714a68 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.443333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a6a1-2697-4585-85ba-baac98714a68 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.443717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a6a1-2697-4585-85ba-baac98714a68 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.445574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 291/596] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:07.451610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad53b7-5e93-474d-acad-3ebf683062e6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.452044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad53b7-5e93-474d-acad-3ebf683062e6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.452424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad53b7-5e93-474d-acad-3ebf683062e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.473425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e5ad53b7-5e93-474d-acad-3ebf683062e6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:07.474651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e5ad53b7-5e93-474d-acad-3ebf683062e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:07.546442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e8ce4-c93a-4c51-b754-677127135c9c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:07.588140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 292/597] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:07.589448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e82c-befe-4ba7-b83f-ac96b41138e9 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.589734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e82c-befe-4ba7-b83f-ac96b41138e9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.590002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e82c-befe-4ba7-b83f-ac96b41138e9 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.591529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 293/598] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:07.591907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:07.595261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.595571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.595854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.596791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.597072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.597348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.615985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:07.616168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:07.617287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:07.617461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:07.638195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:07.639234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:07.640196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 306/599] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:07.645366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:07.651058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:07.678069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:07.714334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 294/600] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:07.819545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290f49b-d3ec-422f-8fb7-0766674b2d94 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:07.852212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:07.852742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:07.853020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:07.853286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:07.853999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:07.854305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:07.855751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:07.873309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 307/601] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Oct 22 23:56:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:07.879021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:07.936308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.059940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d295774-d1a1-4926-b7be-00ed69fcf661 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.101281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.104315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.104315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.104529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.104726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.141587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.153348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e778-3802-4e99-9436-34fd64382909 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.198070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.198715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.198993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.199293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.199883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.201236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:08.220936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:08.221927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:08.222813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:08.227932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.229415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.231218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 308/602] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Oct 22 23:56:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:08.232092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.394214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d651f-8c06-4a83-adb2-e8b25c5b83b7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.418242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 295/603] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:08.420066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.492152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.492807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.493092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.493834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.506048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.517999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:08.530675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:08.531305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:08.532235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:56:08.533370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:08.535443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 309/604] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:08.536562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.586389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f8a5-2963-4235-ba97-30f87071cb3e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.630272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.630882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.631187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.631458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.632073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:08.632372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.633723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.638137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 296/605] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:08.638952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.646467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e657e-d882-4f9a-ae68-3386a3fdbec1 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.680668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.681296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.681577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.681851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.692590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.694006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-c4e11fbd-e1db-44f4-8e59-16bad03f2e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:08.707935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:08.708897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:08.709774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:08.709774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:08.709774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:08.709774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 310/606] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:08.710375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892c3-3c96-4761-9283-6aa5a81bf5f4 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.710375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892c3-3c96-4761-9283-6aa5a81bf5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.710654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb892c3-3c96-4761-9283-6aa5a81bf5f4 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.711891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 311/607] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:08.712893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4f67-3839-46c6-ade5-1484c7d39295 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.713173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4f67-3839-46c6-ade5-1484c7d39295 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.713446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4f67-3839-46c6-ade5-1484c7d39295 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.714613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 312/608] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:08.715327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4f67-3839-46c6-ade5-1484c7d39295 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.741864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b85833-f1f0-42ab-946f-0f687ffb150b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.765577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.772196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:08.777261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.777888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.778166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.778431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.779082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:08.779406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.780739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.788915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 297/609] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:08.789973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.821163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4f67-3839-46c6-ade5-1484c7d39295 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.853356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.853953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.854229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.854495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.855127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:08.855428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.856789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884733b0-6946-4c88-8c9a-fe5f05c058c3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.861046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 313/610] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:08.862147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.862423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.862688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.890004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:08.891648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:08.895205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dff958-b563-4e87-8a3b-13eed2d8330b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:08.934115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:08.935059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.935386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.935670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.936355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:08.936687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:08.938085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e477b-c128-4a97-8631-044cb7f61472 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:08.951866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 298/611] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:08.953148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:08.953431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:08.953704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:08.979110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 314/612] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:08.979110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:08.980804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:08.982187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:09.023172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.035745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.071232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 299/613] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:09.072127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.092007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16096b2-36e7-4b0f-993e-b84716ddc159 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.152029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.152661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.152933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.153201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.167698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.169316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:09.204170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:09.205157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:09.206029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:09.206029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:09.206029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:09.206636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 315/614] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:09.215474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a436982-b87d-43b2-9bce-de4b11a65f70 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.215975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.251399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.252129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.252478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.252816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.260120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.261543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:09.274613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:09.275557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 300/615] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:09.276453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.321150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.359754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.365012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf3387-0f9e-44a7-82c6-71aaa1833402 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.402619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.403094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885575-2e4f-4408-a26c-df0fc424247a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.403289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.403532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.403800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.404510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:09.404726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.406392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.423750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 316/616] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:09.423750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.446048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.446679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.446955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.447269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.447840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.449891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:09.468285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:09.469426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.470871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 301/617] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:09.472448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.539728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be11f0-16c0-404b-924a-58731a7a4e24 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.576447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.579996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a443-e82f-4003-aa51-878defea08b3 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.580945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.581549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.581824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.582093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.582945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:09.583278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.585501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.599929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 317/618] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:09.600904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.622340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.624840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.625488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.625762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.626038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] PATH_INFO: `/v3/services/network` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.627177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.628573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:09.637487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:09.638489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:09.639362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 302/619] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:09.640154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.713594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ed98-b0c9-4b45-ac3c-a2214475454b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.743649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e19f0f-48ec-4b97-a698-f54b9b76086e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.748129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.748755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.749030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.749301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.757175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.758612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:09.770176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:09.771170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 318/620] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:09.772118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.784326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.784943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.785222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.785496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.786126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:09.786426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.787817 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.796952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 303/621] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:09.797768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.826138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.858830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:09.881350 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db84c4-08d7-4023-8d1f-6c451cbd36a3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.905308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555e1c7-10a0-4fdd-95b8-36886d9946a0 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:09.915915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.916517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.916795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.917070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.917780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=318a76b9d85747f5ae83df6d6b497131) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:09.918085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.919527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.926551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 319/622] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/role_assignments?user.id=318a76b9d85747f5ae83df6d6b497131&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:09.927654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:09.954923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:09.955882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:09.956314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:09.956730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:09.957646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] RBAC: Adding query filter params (name=network) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:09.957948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:09.959367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:09.969750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 304/623] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:09.971328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.051911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd051b-ae75-41e1-9596-39ce10d1f8c6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.089826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.090437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.090715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.090984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.091725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.091834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:10.092028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.094226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.113391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.114842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964aa8a-a233-4e4c-8a46-d03cb8405500 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.118024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 320/624] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:10.119406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.158428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.159460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.160072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.160554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.161518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:10.162035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.164424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.170192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 305/625] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Oct 22 23:56:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:10.171408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.239279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa3f1-1d02-45fe-a9e1-e5f29905ef54 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.280679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.281330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.281610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.281876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.283040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] RBAC: Adding query filter params (type=network) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:10.283391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.285436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.295153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 321/626] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:10.296161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.303313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fe11-f79e-4919-be4f-eb5b030f38e5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.339127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.340053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.340525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.340986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.366985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.384531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.419392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.421571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.432203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bb748-7f9e-41d2-bab5-00511163ce2b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.472293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.472898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.473179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.473559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.474212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.475848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.511754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 322/627] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:10.512603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.543336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 306/628] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:10.550866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.621913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.644803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27be75e-c9fe-4764-9def-a2fa5366a8b7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.662806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:10.676434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732c192-e3b4-4c4f-b9a0-cb77443c53d9 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.685808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.686805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.687349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.687831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.688770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.690418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.713923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 323/629] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:10.726111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.726767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.727118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.727449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.740311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.741948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:10.759455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:10.760497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:10.761390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:10.761390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:10.761390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:10.761390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 307/630] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:10.766464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:10.894050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b970-e590-44b7-a7f8-c9cdbe9884ed None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:10.932946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:10.933967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:10.934537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:10.935104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:10.935979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:10.936492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:10.938115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:10.953209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 324/631] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:10.959878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:11.074148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989055e-96e0-48b3-8457-f51ee3e69dc6 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:11.076749 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:11.114465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:11.115165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.115411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.115677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.123225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:11.124659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-2988035d-3140-458b-80e4-1da70ef8e071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:11.137071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:11.137991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:11.138890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 308/632] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:11.143888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:11.195701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:11.239955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182037a4-5ca2-4ed0-b0d7-9c6002e12278 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.240388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182037a4-5ca2-4ed0-b0d7-9c6002e12278 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.240760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182037a4-5ca2-4ed0-b0d7-9c6002e12278 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.242467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 309/633] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:11.247342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.247729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.248105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.270910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:11.272264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:11.273086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaf4c-6bf5-40d9-b8d9-fbf1d2bcb0b4 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:11.314486 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:11.315102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.315407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.315679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.316457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:11.316770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:11.318303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:11.332733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 325/634] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:11.344340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:11.351445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 310/635] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:11.443434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:11.452260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359e1b-8376-4b4f-8277-838c5adad8d0 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:11.488373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:11.488980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.489259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.489534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.490314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=b117c6096699423e861914df7f150e43) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:11.490643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:11.492065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcdbca-e11c-4f2a-87e7-24d800da9664 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:11.498243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 326/636] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:11 2022] GET /identity/v3/role_assignments?user.id=b117c6096699423e861914df7f150e43&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:11.621457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:11.725174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:11.733100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28315-3648-415f-9d94-1887d984cb13 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:11.769445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:11.770121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:11.770402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:11.770674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:11.771354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:11.772707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19bc61-e792-42a5-a8ce-525431c4d655 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:11.790384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 311/637] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:11 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:12.383448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2e5e-e293-47fb-a148-11dd846ff3c8 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:12.383983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2e5e-e293-47fb-a148-11dd846ff3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:12.383983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2e5e-e293-47fb-a148-11dd846ff3c8 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:12.385564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 327/638] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:12.390935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:12.391345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:12.391532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:12.410260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:12.411472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:12.489935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 312/639] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:12.763580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2e5e-e293-47fb-a148-11dd846ff3c8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:12.869133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2e5e-e293-47fb-a148-11dd846ff3c8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:12.904391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:12.905018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:12.905298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:12.905574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:12.906155 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:12.907621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:12.916805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:12.917769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:12.918592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 328/640] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:12.924618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:13.032745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:13.035351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5b9c-2ef4-4a6d-80b0-6d2892373b53 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:13.072646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:13.073262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.073542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.073868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.074570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:13.074872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:13.076324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a509768-9d6c-415d-93e0-adb071ec7bd1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:13.081890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 313/641] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:13.087285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:13.099725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b44-4da5-480e-b85d-61b8c35a63b8 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.100009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b44-4da5-480e-b85d-61b8c35a63b8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.100283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b44-4da5-480e-b85d-61b8c35a63b8 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.101876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 314/642] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:13.106996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.107371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.107876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.112434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:13.132990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:13.134701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:13.204609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468bf8-4d28-459e-839f-c6b5a6e67569 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:13.224190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 315/643] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:13.248684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:13.249503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.249956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.250376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.251684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:13.252128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:13.253628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:13.258589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 329/644] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:13.505324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:13.587819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:13.618453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0588e8-2488-4ca4-a57c-10a01506418a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:13.654354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:13.654992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.655299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.655572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.656154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:13.657575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-49f85fb5-d665-4e10-8dc0-8bc906ecb24c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:13.666870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:13.667932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:13.668824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 316/645] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:13.674904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:13.763689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:13.780256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb18d-e70e-405d-97e5-503909ad0216 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:13.796500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a724-4d17-4d4a-930b-b7873733c7d9 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.796813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a724-4d17-4d4a-930b-b7873733c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.797039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a724-4d17-4d4a-930b-b7873733c7d9 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.799146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 317/646] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:13.804432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba1ac-0174-44e3-908f-a76fb1e7e939 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.804772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba1ac-0174-44e3-908f-a76fb1e7e939 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.805053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba1ac-0174-44e3-908f-a76fb1e7e939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.815233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:13.815837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.816134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.816379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.816993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:13.817287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:13.818622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:13.823641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f27ba1ac-0174-44e3-908f-a76fb1e7e939 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:13.824887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f27ba1ac-0174-44e3-908f-a76fb1e7e939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:13.827844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 330/647] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:13.830086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:13.899339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 318/648] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:13.930482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd095e2-d216-4a2e-9e13-3f869d656be2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:13.967962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:13.968584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:13.968856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:13.969125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:13.970272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:13.970579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:13.971981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b1acd-e7b7-4918-9397-6bde6b3bb43f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:13.983228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 331/649] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:14.075094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1deed-07e7-4b6e-9df4-fd887faca96a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.075741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1deed-07e7-4b6e-9df4-fd887faca96a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.076242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1deed-07e7-4b6e-9df4-fd887faca96a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.078185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 319/650] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:14.084130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.084765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.085241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.105335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:14.106961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:14.119907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.169300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1deed-07e7-4b6e-9df4-fd887faca96a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.186763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 332/651] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:14.248247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.285167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1deed-07e7-4b6e-9df4-fd887faca96a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.319816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.320450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.320815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.321091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.332145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:14.337075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:14.338038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:14.338875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 320/652] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:14.348148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.452496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bb21-6507-484b-9a4c-d45306345afe None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.462234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.489669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.490283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.490564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.490836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.491525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:14.491829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:14.493698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:14.503628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 333/653] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:14.509149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.513649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.594888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ccb5-5efa-4d62-8616-09e7a10e1d35 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.630185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.639151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03935-b1e7-424d-a5f2-fc10b720ee0d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.641454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.643694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.644114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.644548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.645267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:14.646752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:14.659123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:14.660262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:14.661417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:14.669212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 321/654] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:14.670912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.684298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.684940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.685200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.685470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.698474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:14.699949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:14.715973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:14.716941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:14.717835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:14.717835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:14.717835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:14.722228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 334/655] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:14.723083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.787948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.810222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387eeb5-cf22-4c9d-b6b5-3c36e9921627 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.838304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b2e9-b697-401e-bb48-a066829e82d3 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:14.857592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.858518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.858990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.859993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.861165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:14.861671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:14.864137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:14.875727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:14.875727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:14.875727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:14.875727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:14.876646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:14.876913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:14.877132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 322/656] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:14.878173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:14.878738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.895308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 335/657] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:14.896449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:14.947415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:14.994607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86e0d-6085-484e-bbb3-b86146fe2f3f None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.008377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1877aa-223c-4b9d-ba3f-6d767ce4cb18 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.025713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.031890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.033269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.033778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.034263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.035099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:15.035603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.037204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.042852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 323/658] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:15.050322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.050322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.050322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.050322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.051878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.058055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.059514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:15.071478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:15.072615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:15.073728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:15.077313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 336/659] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:56:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:15.078132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.171791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169485-9853-475f-a515-dd5501ba1da4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.183799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c575818-f20b-4a5f-90fe-54e85d2f4f27 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.199927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.221354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.222239 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.222379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.222829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.223239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.223426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.223698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.224064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.224582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] RBAC: Adding query filter params (interface=public, service_id=b3648206f74c4ddfb01326e1ee8d73e8, region_id=RegionOne) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:15.224959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:15.225183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.225444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.226811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.227018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.242398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 324/660] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/endpoints?service_id=b3648206f74c4ddfb01326e1ee8d73e8&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:15.243866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.251166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 337/661] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:15.253603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.289751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.372517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b0a0-5562-4d3d-bbd6-21f6752d36c6 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.385594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23604-e745-4f05-84a5-8362a7340e15 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.412202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.412827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.413215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.413488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.424403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.425734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.431540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.432438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.432908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.433400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.434707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.437010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2e041-4345-47cd-a045-b2a2ca223a5a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:15.442554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:15.443508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:15.444369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:15.444369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:15.444369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:15.451190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 338/663] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:15.451190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.451623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 325/663] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/services => generated 1029 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 23:56:15.486716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa128a-f759-40a7-a36b-8243eb8c77dd None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.487466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa128a-f759-40a7-a36b-8243eb8c77dd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.488044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa128a-f759-40a7-a36b-8243eb8c77dd None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.491300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 326/664] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:15.496440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.497462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.497937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.527382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:15.529581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:15.556186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.574743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964de90-a82e-4f7b-b5fd-642dc30b706e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.597374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.620960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.622140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.622547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.623159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.623903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:15.624295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.626811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.631860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 327/665] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:15.642726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 339/666] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:15.648981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.755816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc5666-8d4a-48a4-b8e0-1256707553b9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.792191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.792831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.793108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.793378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.800391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.801814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:15.813409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:15.814370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:15.815268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 328/667] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:15.820605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.905656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:15.926995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae2df-0e35-4652-9fd4-447454b4a76a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:15.959441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:15.976163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:15.977063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:15.977464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:15.977940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:15.978831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:15.979271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:15.980797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:15.999177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 340/668] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:16.008510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:16.023906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783104-7961-4aeb-8f7d-65a8b8cb4251 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:16.028415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:16.063326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:16.064003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:16.064288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:16.064558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:16.065218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:16.066635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554fcad-236e-45e8-a584-5298cf58ceff None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:16.088404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 329/669] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:15 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:56:16.126741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8672af-c5f7-499f-afb8-4d877ff434be None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:16.181500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:16.182330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:16.182621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:16.182952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/b117c6096699423e861914df7f150e43/roles/a54fe0bd1b414c848faf4e42c056993f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:16.185318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=b117c6096699423e861914df7f150e43, role_id=a54fe0bd1b414c848faf4e42c056993f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:16.186879 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4771-7c18-4f87-ba9c-38d1dfc1e569 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:16.205257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:16 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/b117c6096699423e861914df7f150e43/roles/a54fe0bd1b414c848faf4e42c056993f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:16.270683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44302-75f7-48cd-bbcf-ff2c36631d0f None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:16.270871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44302-75f7-48cd-bbcf-ff2c36631d0f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:16.271203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44302-75f7-48cd-bbcf-ff2c36631d0f None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:16.273050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 330/671] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:16.279746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c173d-d9f2-49fb-88e4-11ae1c98952c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:16.279746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c173d-d9f2-49fb-88e4-11ae1c98952c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:16.279746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c173d-d9f2-49fb-88e4-11ae1c98952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:16.299758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-417c173d-d9f2-49fb-88e4-11ae1c98952c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:16.300991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-417c173d-d9f2-49fb-88e4-11ae1c98952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:16.367107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:16.386612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 342/672] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:16 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:16.652502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44302-75f7-48cd-bbcf-ff2c36631d0f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:16.754482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:16.759462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44302-75f7-48cd-bbcf-ff2c36631d0f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:16.801370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:16.802474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:16.802902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:16.803351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:16.804177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:16.805693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b9fa-504f-4224-8d50-e998703fa724 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:16.822377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 331/673] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:16 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:17.767379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842d38-47f1-4cce-8c4d-0265b682a208 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:17.767915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842d38-47f1-4cce-8c4d-0265b682a208 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:17.767915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842d38-47f1-4cce-8c4d-0265b682a208 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:17.769628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 343/674] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:17.774785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:17.775205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:17.775292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:17.793390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:17.794545 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:17.870261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 332/675] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:18.135411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7842d38-47f1-4cce-8c4d-0265b682a208 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.237627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7842d38-47f1-4cce-8c4d-0265b682a208 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:18.276111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:18.276813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.277094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.277364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.278001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:18.279412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-a44d5c08-942a-45d5-aa46-1a5f8130054a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:18.288951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:18.289923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:18.290799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 344/676] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:18.296320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.382688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5dd1-cdb7-41d1-a36f-a03614aaf33e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.383028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5dd1-cdb7-41d1-a36f-a03614aaf33e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.383271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5dd1-cdb7-41d1-a36f-a03614aaf33e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.384824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 345/677] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:18.390473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b32a0-b68a-4f7e-b87c-13d9f2e2edcf None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.390744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b32a0-b68a-4f7e-b87c-13d9f2e2edcf None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.390943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b32a0-b68a-4f7e-b87c-13d9f2e2edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.394948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:18.412374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456217bf-f113-4c8b-ae57-c4a374a035f8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:18.416116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d51b32a0-b68a-4f7e-b87c-13d9f2e2edcf None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:18.417673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d51b32a0-b68a-4f7e-b87c-13d9f2e2edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:18.454151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:18.454774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.455102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.455351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.455976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:18.456275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:18.457629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:18.467104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 333/678] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:18.469565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.485138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:18.504483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 346/679] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:18.512704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9129-c5d6-4da3-a553-0cedf3b8e789 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.513060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9129-c5d6-4da3-a553-0cedf3b8e789 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.514266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9129-c5d6-4da3-a553-0cedf3b8e789 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.520593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 347/680] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:18.524023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.524379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.524725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.548768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:18.550299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:18.606537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45238-2555-4140-93fe-e8887cae07b2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:18.634935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 348/681] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:18.656265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:18.657647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.658085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.658546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.659341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:18.659882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:18.661426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:18.667030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 334/682] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:18.676157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.776687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.779662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170c766-0ed9-4dec-b504-aea71e75b805 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:18.793214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:18.800628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:18.824316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:18.825285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.825569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.825841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.826505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:18.828464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:18.853633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 349/683] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:18.899638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3354a-5312-4990-9afa-ed54b14b3584 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:18.947404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:18.947734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:18.948286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:18.948556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:18.948865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:18.949457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:18.952349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:18.964869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:18.965915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:18.966768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:18.967571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 335/684] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:18.974727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.053280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.066630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d45574-7fd5-4016-98d7-ed33058ee71e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.087111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded152be-1634-40dc-bf48-d9f4296d11d8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.107165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.107806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.108084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.108355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.119009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-05b7099f-0434-4b58-8df4-07ef06480fe8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:19.124280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:19.125240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:19.126234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:19.126875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.126875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.126875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.127640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 350/685] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:19.127731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.127731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:19.127731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.127905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673e06-6a00-406f-af29-8436e40f54a3 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.128247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.131936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673e06-6a00-406f-af29-8436e40f54a3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.132206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673e06-6a00-406f-af29-8436e40f54a3 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.137639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 336/686] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:19.137793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 351/687] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:19.137905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.138470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673e06-6a00-406f-af29-8436e40f54a3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.173236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.250527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7b9a-f97f-4ea6-84e2-a647c1ab2af6 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.254521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673e06-6a00-406f-af29-8436e40f54a3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.286820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.287458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.287734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.288004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.288671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:19.288973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.290319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.290641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.291268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.291558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.291805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.292423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:19.292729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.292829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.294030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6310-5fc2-4b9b-916e-9af06593dc4b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.299249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 352/688] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:19.300532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.300815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.301084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.301551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 337/689] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:19.308682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.320555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:19.321734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:19.403388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 353/690] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:19.404181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.416044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dd2e8-6360-48e3-9681-05dc3a85f6e4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.443608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.453527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.454702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.454980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.455277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.456423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] RBAC: Adding query filter params (interface=public, service_id=9fdd7142cc01491196846795a0edabb0, region_id=RegionOne) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:19.456423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.457712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.468004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 338/691] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/endpoints?service_id=9fdd7142cc01491196846795a0edabb0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:19.469020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.537064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.539558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd44f-0ec6-44de-b34a-c1b9f97d56f8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.579741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88bd6-1677-4077-9571-634463094e84 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.588194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.589075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.590056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.590526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.604873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.607056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.616046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.616782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.617124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.617464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.618183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.619665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.626244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 339/692] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:19.627450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:19.628374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:19.629253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:19.629253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:19.629253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:19.635501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 354/693] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:19.637359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.669695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.767840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.775620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04455335-2b63-4fe6-beaf-d4d5057e878a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.794144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ede3-c80c-4bf3-8fad-4a6c5583b1b7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.813707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:19.824593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.825203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.825475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.825745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.826516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:19.826702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.828064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.840764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 340/694] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:19.845262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:19.846125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:19.846407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.846784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:19.847303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:19.848114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:19.849990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:19.861986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:19.862953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:19.863850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 355/695] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:19.869326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:19.966701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361968-fbc0-4223-8036-cd74043ddb3b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:19.989346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5e1f-3d71-4eb0-968b-af0fb25ab323 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.002827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.003554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.003960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.004235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.012015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.013524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:20.025110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:20.026267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 22 23:56:20.027422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:20.028187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 341/696] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:20.033393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.033680 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.034009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.034293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.034653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.035310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:20.035612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.036975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.052011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 356/697] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:20.053941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.063976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.091486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.148120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b344132-ffe8-4162-9986-15da3e7b2d50 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.181859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e750-adc2-4918-b309-c753095ccd9f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.194854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.195832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.196348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.196912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.197926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:20.198445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.200204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.218577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.219343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.220155 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.220426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.221041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:20.221456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.221681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 342/698] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:20.222697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.227985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 357/699] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:20.229170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.236024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.308243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.341200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7f3f9-9056-4701-bc74-8686519d7e9e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.341986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2844c-0640-4d5f-8efa-2731f0881c59 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.344333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.380305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.381330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.381874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.382357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.383316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] RBAC: Adding query filter params (interface=public, service_id=823824ec6c3f43e3901aa53510e852bd, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:20.383446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.383889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.384257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.384625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.384988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.385923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.396829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 358/700] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/endpoints?service_id=823824ec6c3f43e3901aa53510e852bd&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:20.397953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.460853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.462542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.503166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb37344-edd4-49ae-918b-21507385318d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.540014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.540789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.541231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.541655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.542430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.543977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.545382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.560055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 359/701] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 23:56:20.584173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 343/702] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:20.588191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.705438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f21d-7823-475b-9b89-41dff1feca69 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.743400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.744450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.744921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.745391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.757292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.758983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:20.774122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:20.775311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:20.776446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:20.776446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:20.776446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:20.783161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 360/703] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:20.784681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:20.788880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:20.888966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2126a1-aea7-414a-8dae-c691849edd96 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:20.924566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:20.925186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:20.925794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:20.925999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:20.926633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:20.926933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:20.928618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f094ea4-0e39-427c-861d-147465b595df None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:20.945372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 344/704] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:20.946835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.002348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:21.056623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c955d-977c-4120-aeb0-2ee65d94471d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.091477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.092442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.092915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.093403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.100893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.102650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:21.103215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55200-24f6-40aa-9d8c-cd10147ce4ef None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.103500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55200-24f6-40aa-9d8c-cd10147ce4ef None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.103776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b55200-24f6-40aa-9d8c-cd10147ce4ef None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.105342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 345/705] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:21.110902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.111245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.111525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:21.116583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:21.117447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:21.118333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:21.120324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 361/706] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:21.127815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.130239 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:21.131529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:21.195103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:21.205118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 346/707] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:21.246329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316ccf1-218c-4d89-b7ef-f3c43a6d54aa None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.256969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:21.283675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.284584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.285054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.285541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.286421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:21.286943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.288553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:21.306940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 362/708] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:21.308524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.413807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740e75a-7eda-47f2-a9dc-dee6103d9879 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.449741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.450567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.450985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.451436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.452295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] RBAC: Adding query filter params (role.id=a54fe0bd1b414c848faf4e42c056993f, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=b117c6096699423e861914df7f150e43) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:21.452794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.454447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:21.467250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 347/709] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:21 2022] GET /identity/v3/role_assignments?user.id=b117c6096699423e861914df7f150e43&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=a54fe0bd1b414c848faf4e42c056993f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:21.478918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.595511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac20566-b023-40cd-9c3f-8953507b93d1 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.632950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.633599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.633873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.634141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.634720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.636128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:21.645583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:21.646625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:21.647513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 363/710] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:21.655558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.723338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:21.771836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbad9f-cfaa-4091-9b45-5003994dd57e None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.806771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.807401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.807675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.807942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.808552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:21.808848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.810182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd942ff6-3ae3-48fa-9902-0fe1db49f222 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:21.815390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 348/711] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:21.820962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:21.849022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349faf0a-6a8f-44aa-a67e-f4cd291561e2 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.849643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349faf0a-6a8f-44aa-a67e-f4cd291561e2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.850141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349faf0a-6a8f-44aa-a67e-f4cd291561e2 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.851947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 349/712] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:21.858018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.858536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.859006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.872737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:21.883525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:21.885646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:21.949512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d18ca-161b-4300-8e01-38c720d3d8ce None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:21.975878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 350/713] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:21.991163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:21.992071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:21.992496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:21.992908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:21.993801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:21.994247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:21.995793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:22.001144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 364/714] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:22.247014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:22.302071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:22.355584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa611-e093-4e89-a9c6-6c8baeff9f4c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:22.390459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:22.391175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.391480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.392287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.392867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:22.394215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:22.403022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:22.404022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:22.404864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 351/715] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:22.410602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:22.527453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:22.534567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ef64-2555-45c6-9647-b2263b910edd None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:22.570435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:22.571043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.571361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.571638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.572261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:22.572560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:22.573907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:22.579627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 365/716] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:22.585354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:22.687606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff402fd-e5d1-4fd8-a2b9-11af91cbd9a7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:22.708604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:22.727876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:22.728486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.728762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.729033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.729656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:22.729960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:22.731334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717b277-1215-4850-a91a-6d08a8e08c24 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:22.736781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 352/717] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:22.742299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:22.850877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2e444-7243-4d4f-98c9-744fa42e135f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:22.885996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:22.886600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.886877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.887181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.887856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:22.889203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31e812-24f6-4e18-bb33-615fe1fd2121 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:22.913728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 366/718] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:22.917673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba5aa-30b1-4112-873f-a3ef424fc29a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.917955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba5aa-30b1-4112-873f-a3ef424fc29a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.918284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcba5aa-30b1-4112-873f-a3ef424fc29a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.919963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 353/719] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:22.925821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:22.926137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:22.926365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:22.946911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:22.948219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:22.964087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:23.033840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 367/720] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:23.305094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba5aa-30b1-4112-873f-a3ef424fc29a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:23.413139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcba5aa-30b1-4112-873f-a3ef424fc29a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:23.451867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:23.452499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.452774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.453043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.453619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:23.455535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:23.464728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:23.465684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:23.466513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 354/721] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:23.472117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:23.585851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f6ef7-99c9-4969-b6a6-737e009c59fa None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:23.629499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:23.630124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.630399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.630669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.631333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:23.631634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:23.632995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a28958-89db-4c2b-afa7-64ebdaf9a4ea None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:23.638492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 368/722] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:23.644290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:23.696058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:23.723748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a24-b573-4cac-a8d0-4b785d8149b2 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.723748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a24-b573-4cac-a8d0-4b785d8149b2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.724005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6a24-b573-4cac-a8d0-4b785d8149b2 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.725569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 369/723] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:23.730515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.730798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.731092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.750418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:23.751742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:23.754084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:23.757837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af539-e0fb-4c8f-96c6-8290ba5cb374 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:23.798374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:23.798995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.799304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.799578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.800209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:23.800677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:23.802487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:23.808124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 355/724] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Oct 22 23:56:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:23.814473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:23.830107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 370/725] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:23.932802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa53f9-a9c6-427c-bbfb-27bebcc377fd None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:23.943237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:23.974085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:23.974085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:23.974085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:23.974085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:23.974509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:23.974509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:23.997960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 356/726] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:56:24.119472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:24.230480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb052bc8-db71-4c68-a5b8-4bcc6d46d47a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:24.274188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:24.274835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.275131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.275404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.275992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:24.277370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:24.279491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-32985aec-9172-4337-88e4-720d19dffdc9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:24.289340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:24.291405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:24.292320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 371/727] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Oct 22 23:56:24 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:24.296696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:24.404549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edd76e-8445-4716-b9ae-5fcd460cce0b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:24.415620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183d5-1709-4755-9df7-fc6c60a54884 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.416207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183d5-1709-4755-9df7-fc6c60a54884 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.416681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183d5-1709-4755-9df7-fc6c60a54884 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.418460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 372/728] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:24.424847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.424847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.424847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.441491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:24.441491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.441796 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.442035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.442524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] RBAC: Adding query filter params (name=image) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:24.442826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:24.444236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:24.449468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 357/729] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:24.454969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:24.455337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:24.456712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:24.489516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:24.551566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 373/730] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:24.584312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa996bc-3919-4436-9496-3cff8566d812 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:24.623459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:24.624077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.624357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.624632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.625261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:24.625572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:24.627483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7786b-c72c-40a6-b7e4-c809be370ca6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:24.632718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 358/731] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:24.840010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:24.943402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cb0f4-c629-4c0f-9253-949eab20f526 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:24.974348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:24.983017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:24.984019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:24.984521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:24.985042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:24.986419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:24.988026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f03dbd-11d2-4015-80d9-62c79983b78b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:25.006257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 374/732] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:24 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:25.183205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319faa7f-cd81-45c9-a17d-d3342036c89a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:25.183499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319faa7f-cd81-45c9-a17d-d3342036c89a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:25.183692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319faa7f-cd81-45c9-a17d-d3342036c89a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:25.185299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 359/733] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:25.191233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:25.191698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:25.191807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:25.211747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:25.213231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:25.291770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 375/734] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:25.558286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319faa7f-cd81-45c9-a17d-d3342036c89a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:25.656759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:25.666974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319faa7f-cd81-45c9-a17d-d3342036c89a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:25.701097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:25.701787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:25.702113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:25.702387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:25.702959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:25.704961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:25.713863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:25.714843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:25.716278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 360/735] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:25.721212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:25.825853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae4cd-0172-483a-ba78-469a474de23f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:25.841585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:25.862620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:25.863322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:25.863825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:25.864279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:25.864901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:25.865199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:25.866552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:25.872073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 376/736] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:25.877927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:25.984249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7c32-72f9-4af2-b403-09d9f3ecc743 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:26.020007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:26.020620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.020899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.021173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.021799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:26.022102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:26.023489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:26.028777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 361/737] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:26.034835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:26.134501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14021d-c80e-4a87-86e9-55f4fe4b67c8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:26.169140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:26.169743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.170019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.170288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.170976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] RBAC: Adding query filter params (interface=admin, service_id=9fdd7142cc01491196846795a0edabb0, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:26.171306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:26.172694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d6ff1-0841-47b5-89a7-da4466537160 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:26.178511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 377/738] 10.222.0.20 () {56 vars in 1249 bytes} [Sat Oct 22 23:56:26 2022] GET /identity/v3/endpoints?service_id=9fdd7142cc01491196846795a0edabb0&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:26.184211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:26.215507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:26.286206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68c055-8660-4ee7-b9a8-001d8599be0b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:26.325255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:26.326242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.326804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.327331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.328144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:26.330313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a410e-8fe4-47e0-84da-d0b75656cd86 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:26.338037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 362/739] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:26 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 23:56:26.433718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a626-10d2-43e4-984e-d44a0a864de4 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.434231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a626-10d2-43e4-984e-d44a0a864de4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.434231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a626-10d2-43e4-984e-d44a0a864de4 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.435856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 378/740] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:26.441626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28c3-e699-4700-8bc4-653a81e01b95 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.441905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28c3-e699-4700-8bc4-653a81e01b95 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.442184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28c3-e699-4700-8bc4-653a81e01b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.462125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4ddb28c3-e699-4700-8bc4-653a81e01b95 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:26.463386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4ddb28c3-e699-4700-8bc4-653a81e01b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:26.544480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 363/741] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:26.812559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a626-10d2-43e4-984e-d44a0a864de4 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:26.867002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:26.925539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a626-10d2-43e4-984e-d44a0a864de4 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:26.940494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d02-1807-44d6-9e5d-13264e43136b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.941404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d02-1807-44d6-9e5d-13264e43136b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.941879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d02-1807-44d6-9e5d-13264e43136b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.943715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 364/742] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:26.949305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.949826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.950607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.961997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:26.962604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:26.962878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:26.963172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:26.963820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:26.965226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:26.968738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING keystone.server.flask.common [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 22 23:56:26.973057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:26.974744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:26.987630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:26.989016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.sql.core [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:26.989016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:56:26.989016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [parameters: {'id': '922fe43b1a11422c9498de7367523fbd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 22 23:56:26.989016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 922fe43b1a11422c9498de7367523fbd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 922fe43b1a11422c9498de7367523fbd. Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:26.998763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 23:56:26.999619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application yield resource Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise self.value Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application session.commit() Oct 22 23:56:27.001138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.flush() Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application compat.raise_( Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 23:56:27.002060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 23:56:27.002964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:27.003793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [parameters: {'id': '922fe43b1a11422c9498de7367523fbd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:27.004671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:27.005480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 922fe43b1a11422c9498de7367523fbd. Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 379/743] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Oct 22 23:56:26 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:27.008584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:27.066337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 365/744] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:27.121979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:27.126756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ac2e-3015-41fd-a12b-d8a0fcf3d11e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:27.168370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:27.169384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.169864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.170345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.178850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:27.180786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-55651595-53de-45ac-b06e-ed6c3ea588a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:27.192766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:27.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:27.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:27.197012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 380/745] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:27.203106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:27.255245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c16b9c-d6dc-40b7-bb48-26cb6a5e6aab None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.255584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c16b9c-d6dc-40b7-bb48-26cb6a5e6aab None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.255792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c16b9c-d6dc-40b7-bb48-26cb6a5e6aab None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.263742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 381/746] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:27.265357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.265736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.266014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.285876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:27.287672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:27.308960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fa35-85fd-4840-843b-7ce0a4d2fff9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:27.346324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:27.346972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.347269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.347538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.348192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:27.348496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:27.349893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:27.364064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 382/747] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:27.364064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:27.372961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 366/748] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:27.468006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:27.482356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ea0dd-1069-4652-b6b7-fc01e89eaaff None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:27.529312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:27.530276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.530766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.531284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.532726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:27.534360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:27.551934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 383/749] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:27 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:27.642610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:27.646653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:27.759754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eef0d-c8d3-4321-ae77-f10d9662607c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:27.803108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:27.803748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.804154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.804428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.805004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:27.806363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:27.815503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:27.816475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:27.817698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 367/750] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:27.822746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:27.926665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bdb58-5dff-4e44-89f7-26095964b451 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:27.966245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:27.966245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:27.966245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:27.966245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:27.966647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:27.966647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:27.966647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:27.971523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 384/751] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:27.976869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:28.045680 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:28.089246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c60b2-cf7d-4315-82a2-7928c64ba395 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:28.128843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:28.129470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:28.129752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:28.130027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:28.130657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:28.130960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:28.132471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:28.137963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 368/752] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:28.144057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:28.160087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:28.252275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441658-b4b2-439f-a112-8539ca79daf7 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:28.287927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:28.289007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:28.289379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:28.289656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:28.290635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] RBAC: Adding query filter params (interface=public, service_id=09ccdf5471fd4153a95b283a261923a0, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:28.291211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:28.292709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b3a6a-c416-4a65-8384-9056e8f473c4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:28.299123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 385/753] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:28 2022] GET /identity/v3/endpoints?service_id=09ccdf5471fd4153a95b283a261923a0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:28.305060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:28.412803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061a31-0e02-4b0e-afdb-5a56bbe1cd13 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:28.440749 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:28.448566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:28.449242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:28.449678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:28.450176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:28.450775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:28.452171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad919cc-01e7-43f5-a3ad-4797b5618556 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:28.459226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 369/754] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:28 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 23:56:28.601159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf160-0662-406e-8d38-55bfea8ab78c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:28.601681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf160-0662-406e-8d38-55bfea8ab78c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:28.601681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf160-0662-406e-8d38-55bfea8ab78c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:28.603447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 386/755] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:28.609225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:28.609515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:28.609786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:28.629295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:28.630533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:28.702088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 370/756] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:28 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:28.971053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf160-0662-406e-8d38-55bfea8ab78c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:29.048940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:29.073161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf160-0662-406e-8d38-55bfea8ab78c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:29.106444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:29.107094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.107376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.107645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.108215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:29.109561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:29.118654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:29.119646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:29.120479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 387/757] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Oct 22 23:56:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:29.126635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:29.228051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3ecf-c431-4b11-b1bd-8e9590cc950f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:29.251848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:29.264211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:29.264823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.265095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.265370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.265988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:29.266431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:29.267883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:29.273147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 371/758] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:29.278878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:29.385386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d0fa7-a9a4-41c7-9ecf-ecdc1c51280b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:29.423708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d5805-8b40-4342-b891-23705761a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:29.424363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d5805-8b40-4342-b891-23705761a56c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.424641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d5805-8b40-4342-b891-23705761a56c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.424906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d5805-8b40-4342-b891-23705761a56c None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.425519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d5805-8b40-4342-b891-23705761a56c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:29.425819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d5805-8b40-4342-b891-23705761a56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:29.427438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d5805-8b40-4342-b891-23705761a56c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:29.432655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 388/759] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Oct 22 23:56:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:29.437900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:29.538900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56c0c2-de77-4f14-b7e6-3af9549aaafa None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:29.574422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:29.575028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.575368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.575636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.576302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:29.577658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db8f5a-b909-4526-a3f0-f9404599839e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:29.598269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 372/760] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:29.731380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca0bc3-8335-4de0-a442-fc4c9e4d10dc None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.731924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca0bc3-8335-4de0-a442-fc4c9e4d10dc None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.731924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca0bc3-8335-4de0-a442-fc4c9e4d10dc None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.733562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 389/761] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:29.739450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf75a7-b868-4407-af74-39052ed37cb6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.739752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf75a7-b868-4407-af74-39052ed37cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.740000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf75a7-b868-4407-af74-39052ed37cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.759828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-35bf75a7-b868-4407-af74-39052ed37cb6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:29.761024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-35bf75a7-b868-4407-af74-39052ed37cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:29.807144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:29.851203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 373/762] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:29.936697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1e6b-fcae-458d-b2ff-d8c395e02fa2 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.937034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1e6b-fcae-458d-b2ff-d8c395e02fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.937230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1e6b-fcae-458d-b2ff-d8c395e02fa2 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.939108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 390/763] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:29.944499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f768-8e56-402e-8376-791bc432d918 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:29.944859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f768-8e56-402e-8376-791bc432d918 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:29.945203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f768-8e56-402e-8376-791bc432d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:29.963747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7195f768-8e56-402e-8376-791bc432d918 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:29.964932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7195f768-8e56-402e-8376-791bc432d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:30.033865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 374/764] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:30.126065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1e6b-fcae-458d-b2ff-d8c395e02fa2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.130079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:30.229510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1e6b-fcae-458d-b2ff-d8c395e02fa2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.264294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.264889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.265162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.265427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.266066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.268221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.284219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.sql.core [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 23:56:30.284219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 22 23:56:30.284219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [parameters: {'user_id': '9b2609959f534a9ebad16f0bf28c6b25', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 22 23:56:30.284219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:30.291241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:30.292592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application yield resource Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise self.value Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application session.commit() Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 23:56:30.294413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.flush() Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application compat.raise_( Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 23:56:30.296485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:30.300450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:30.311794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [parameters: {'user_id': '9b2609959f534a9ebad16f0bf28c6b25', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:30.313608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 22 23:56:30.314638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.315838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 391/765] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Oct 22 23:56:30 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:30.316323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f768-8e56-402e-8376-791bc432d918 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.316732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.395980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:30.422375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f768-8e56-402e-8376-791bc432d918 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.424365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:30.444874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af01d-3f39-4450-baaa-c0cd2053b4ec None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.462569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.463358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.463698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.464026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.472391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.474001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.486256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.486890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.487196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:30.487350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:30.489151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 23:56:30.491427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:30.492665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.492665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.492665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.499107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 375/766] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:30.499107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:30.500152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:30.502553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:30.504326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:30.507110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 392/767] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:30.508694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.628234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42800a8-76da-45b8-9022-f617cba04a4b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.640354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f256-ce79-46f9-9d15-fa1bb5a7d7e4 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.665024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.665942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.665942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.666215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.667264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:30.667633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.669171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807f58-64c9-4aee-85be-3a62651a4e4f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.682272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:30.691284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.692220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.692674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.693119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.693955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] RBAC: Adding query filter params (name=image) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:30.694434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.696090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.712219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 393/768] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:30.713206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.723226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 376/769] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:30.790853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7cc29-4f1a-43ed-bc3f-bfd4196b08a0 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.791218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7cc29-4f1a-43ed-bc3f-bfd4196b08a0 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.791420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7cc29-4f1a-43ed-bc3f-bfd4196b08a0 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.793061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 377/770] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:30.801789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.802480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.802852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.822967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:30.824458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:30.841570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:30.842406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2796-66c5-476e-b3f4-dac68b4cb67a None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:30.891021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:30.892437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:30.892854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:30.893269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:30.894060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] RBAC: Adding query filter params (type=image) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:30.894562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:30.896258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:30.902270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 394/771] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:30.908605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:30.912044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 378/772] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:30.970223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:31.013852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaf65-befb-4d89-b260-67c80a0c7550 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.050502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.051210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.051490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.051760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.052710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] RBAC: Adding query filter params (interface=public, service_id=880c9070a56f4ec0830b61a4f5dd7eef, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:31.053019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.054369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.060661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 395/773] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:56:30 2022] GET /identity/v3/endpoints?service_id=880c9070a56f4ec0830b61a4f5dd7eef&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:31.065624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:31.166549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e4529-54ed-44c5-9a2b-958c4e089d51 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.193975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:31.201024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.201630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.201909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.202181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.202782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.204759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.215108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 379/774] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:56:31 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 23:56:31.300491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c2b7-c6e5-4ce1-adc2-6c9ec0d0b4ff None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.324188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:31.336728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.337369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.337645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.337915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.338495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.339899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:31.349917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:31.350968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:31.352516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 396/775] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:31.357109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:31.375227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:31.464784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f068c-539f-461e-8fa1-3c13361b0136 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.499732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.500394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.501207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.501585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.502205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:31.502501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.503905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.510447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 380/776] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:31.514447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:31.618280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efcf0e-57d9-400d-8488-cdd97ef4b38f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.651438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.652047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.652325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.652599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.653219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:31.653520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.654864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9d6d3-df63-4e7e-870f-87c706cd792e None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.664396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 397/777] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Oct 22 23:56:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:31.665945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:31.751521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:31.774435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfb23-d5ee-4b9c-964a-ab28565a4897 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:31.808959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:31.809568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.809849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.810120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.810793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:31.812180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e017967-892a-4c0f-b39d-05c4e2a6b0f0 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:31.835978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 381/778] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:56:31.836162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549cb25-cbd4-4fbf-87ba-f343fe822e53 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.836162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549cb25-cbd4-4fbf-87ba-f343fe822e53 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.836162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549cb25-cbd4-4fbf-87ba-f343fe822e53 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.836162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 398/779] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:31.840393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:31.840681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:31.840959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:31.860632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:31.861872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:31.941350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 382/780] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:32.209786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549cb25-cbd4-4fbf-87ba-f343fe822e53 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:32.260732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:32.313058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549cb25-cbd4-4fbf-87ba-f343fe822e53 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:32.346996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:32.347656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:32.347975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:32.348256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:32.349349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:32.350800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ee610-4772-4742-b00f-37847cbdda84 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:32.352646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 399/781] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:32.358210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:32.418764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:32.462134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deff66e-2c03-4c8d-975c-d3dcf7bb9354 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:32.496465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:32.497085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:32.497362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:32.497633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:32.498289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:32.499738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fa03-032a-401b-96fb-5b7b2c91933f None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:32.533911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 383/782] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:32 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:33.428046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ea7a-b19a-49a6-beac-614b2a3a5967 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:33.428560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ea7a-b19a-49a6-beac-614b2a3a5967 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:33.428670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ea7a-b19a-49a6-beac-614b2a3a5967 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:33.430063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 400/783] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:33.435508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:33.435997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:33.436068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:33.455721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:33.456906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:33.530354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 384/784] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:33.801530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ea7a-b19a-49a6-beac-614b2a3a5967 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:33.903337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ea7a-b19a-49a6-beac-614b2a3a5967 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:33.920525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:33.938733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:33.939389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:33.939668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:33.939934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] PATH_INFO: `/v3/services/image` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:33.940499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:33.941835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-16e0d583-cc91-404d-82e6-dfcf619b2edd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:33.950441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:33.951429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 23:56:33.952272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:33.954135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 401/785] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Oct 22 23:56:33 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:33.957938 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.004379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:34.063902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2630b8-6ae6-4105-9efb-0c86782150ce None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.093870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153517-3dee-47f7-a775-21c07ff1a5be None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.094148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153517-3dee-47f7-a775-21c07ff1a5be None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.094422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153517-3dee-47f7-a775-21c07ff1a5be None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.095831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 402/786] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:34.100260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.100639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.100870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.100971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.101148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.101257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.101422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.102044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] RBAC: Adding query filter params (name=image) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:34.102342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:34.103755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:34.108834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 385/787] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:34.114800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.120500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:34.122000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:34.197953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 403/788] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:34.221118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a40422-6e73-40fb-bb46-613085cad847 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.229104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:34.257151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.257785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.258028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.258297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.258908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] RBAC: Adding query filter params (type=image) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:34.259249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:34.260602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:34.265486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 386/789] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:34.271608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.369362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb361-7a75-4aaa-bce7-dc9c745fb950 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.383258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:34.406273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.407126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.407578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.408024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.408822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:34.410320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:34.431010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 404/790] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:56:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:56:34.466208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.584719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4274d9-8c14-4eb9-a60a-c094fca0c276 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.632367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.632930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.633211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.633483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.645059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-aaed0908-687c-4388-a1a8-545f7c120c72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:34.649864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:34.650972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:34.652062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 387/791] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:56:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:34.658189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.715581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dbc6-4036-4b67-be40-3ddedd461645 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.715925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dbc6-4036-4b67-be40-3ddedd461645 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.716126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587dbc6-4036-4b67-be40-3ddedd461645 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.717577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 388/792] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:34.722557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.722843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.723146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.743319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:34.744511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:34.764820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:34.767939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c59db2-1078-4618-b167-39b26b5c8c75 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.807914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.808517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.808815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.809048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.809700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:34.809994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:34.811357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:34.814384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 389/793] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:34.819887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 405/794] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Oct 22 23:56:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:34.825371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:34.927901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d9f77-1f05-4dc7-9bd8-4b8999a9b43f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:34.961868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:34.962495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:34.962773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:34.963039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:34.973482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:34.974914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:34.989378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:34.990305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:34.991627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:34.991627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:34.991627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:34.995172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 390/795] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:34.996382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.029299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.084765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.095883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.105440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe82830-404b-4f18-87e8-b8eaf1457436 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.147171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.148095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.148646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.148927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.149568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:35.149873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.151417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.165531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 406/796] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:35.171497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.194326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a12ad-4c6c-4509-b505-6a23cde98391 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.233029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.233730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.233998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.234273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.235702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.237153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.238879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 391/797] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:35.244377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.272013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.283823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb77d26-f06b-4efe-b99a-10d8aab5d585 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.323699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.324709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.325242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.326040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.326516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.335086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.336655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:35.348388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:35.349571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:35.350680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:35.351502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 407/798] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:56:35.353778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a18b66-e432-4846-a611-6c058c058112 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.357487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.393928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.394539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.394818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.395101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.395756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.397177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.419633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 392/799] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:56:35 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:56:35.476874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce337cf-6e38-4c91-967b-eb148faf0628 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.519570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.520646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.521108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.521514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.522389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:35.522909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.524710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.551048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 408/800] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:35.552726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.660583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f724f-8009-4f0d-9976-4722f39abd1d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.690037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.696337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.697144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.697387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.697785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.709074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.710590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:35.725666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:35.726599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:35.727566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:35.727566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:35.727566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:35.727566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 393/801] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:35.732439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.743864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:35.834611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c291483-ee0e-41d3-bab6-15fbb864b7d5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:35.867183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:35.867782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:35.868059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:35.868328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:35.868954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:35.869253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:35.870601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:35.882353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 409/802] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:35.887752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:35.989541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e263fa-f125-4985-9944-a4b2b6ddb828 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:36.024180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:36.024804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:36.025077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:36.025348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:36.031920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:36.033339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:36.044262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:36.045283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:36.046153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 394/803] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:36.051742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:36.123219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:36.158620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f41b-0d1b-4e00-a2f2-a66f3cc12cfa None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:36.193679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:36.194282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:36.194557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:36.194827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:36.195540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:36.195844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:36.197252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9c51-c803-4500-b1d8-487aa9e50ffa None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:36.214907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 410/804] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:36.216081 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:36.262421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:36.318368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf78-dabd-41a9-b4d5-bc4d935ac74a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:36.354389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:36.355050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:36.355352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:36.355625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/a54fe0bd1b414c848faf4e42c056993f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:36.357728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=81aba6d76ac940dcaa33247c65cc57b0, role_id=a54fe0bd1b414c848faf4e42c056993f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:36.359168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65fd8b-92c5-4559-83fe-a12b5ed07711 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:36.374298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 395/805] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:36 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/81aba6d76ac940dcaa33247c65cc57b0/roles/a54fe0bd1b414c848faf4e42c056993f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:36.657667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ed00-6026-4aa9-bba7-e0db0708c406 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:36.658161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ed00-6026-4aa9-bba7-e0db0708c406 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:36.658237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0ed00-6026-4aa9-bba7-e0db0708c406 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:36.659792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 411/806] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:36.664902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:36.665279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:36.665451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:36.684480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:36.685681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:36.754662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 396/807] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:37.023362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ed00-6026-4aa9-bba7-e0db0708c406 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:37.124263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0ed00-6026-4aa9-bba7-e0db0708c406 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:37.150571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:37.159944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:37.160551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:37.160827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:37.161098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:37.161828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:37.163296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:37.171050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.sql.core [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:37.171050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:56:37.171050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [parameters: {'id': '4419b700bec54b1197be165d74e90daf', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 23:56:37.171050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81356) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:37.178569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 23:56:37.179578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application yield resource Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application next(self.gen) Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise self.value Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application session.commit() Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 23:56:37.180554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.session.flush() Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application compat.raise_( Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 23:56:37.181472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 23:56:37.182347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application conn.query(q) Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application result.read() Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 23:56:37.183931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [parameters: {'id': '4419b700bec54b1197be165d74e90daf', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 23:56:37.189934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:37.191761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:37.194109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 412/808] 10.222.0.20 () {60 vars in 1137 bytes} [Sat Oct 22 23:56:37 2022] POST /identity/v3/domains => generated 190 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:37.196703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:37.226857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:37.296565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026dbdc-92d7-4082-a2be-13bf1cd82673 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:37.331188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:37.331821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:37.332101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:37.332432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:37.342362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:37.343836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-3923d32b-8a79-48cd-a03c-544d3880b9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:37.359819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:37.360854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:37.361766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:37.361766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:37.361766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:37.362539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 397/809] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:37.366934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:37.466113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199ec0-6240-41e8-b50d-fdc900988f52 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:37.499763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:37.500921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:37.501206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:37.501479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:37.502136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:37.502441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:37.503890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672e47c-968f-44d2-99b0-4541bed65678 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:37.523596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 413/810] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:37.621155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97e9ac-e7f5-4120-9161-065696a18aed None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:37.621484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97e9ac-e7f5-4120-9161-065696a18aed None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:37.621714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97e9ac-e7f5-4120-9161-065696a18aed None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:37.623248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 398/811] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:37.628679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:37.629013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:37.629234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:37.648901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:37.650101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:37.700532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:37.722286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 414/812] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:37.986027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97e9ac-e7f5-4120-9161-065696a18aed None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.069825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:38.085758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97e9ac-e7f5-4120-9161-065696a18aed None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.118061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.118679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.118950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.119242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.129963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:38.134656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:38.135617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:38.136546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 399/813] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:38.142233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.237702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b596aee-bbe1-4aff-bfcf-9cd6dce9df79 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.270635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.271264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.271539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.271807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.272449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:38.272743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:38.274083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:38.281793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 415/814] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:38.287534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.387260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d7b7-a26b-458e-93a3-bf560b5baeee None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.422848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.423509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.423787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.424056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] PATH_INFO: `/v3/users/5dddedddc2e14df684ad49e8e64f6a25` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.437366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] RBAC: Authorizing `identity:get_user(user_id=5dddedddc2e14df684ad49e8e64f6a25)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:38.439463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db39ff4-5161-41ad-99bf-4d041397b072 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:38.441077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 400/815] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:38 2022] GET /identity/v3/users/5dddedddc2e14df684ad49e8e64f6a25 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:38.446727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.492441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:38.495000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c68b1-b4f7-4960-a4ad-5558c6a7dd0b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.495335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c68b1-b4f7-4960-a4ad-5558c6a7dd0b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.495610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c68b1-b4f7-4960-a4ad-5558c6a7dd0b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.496943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 401/816] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:38.502421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.502700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.502971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.510118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:38.521833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:38.523021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:38.553409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631901dd-df24-4c27-a631-e289260df1b2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.586524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.587171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.587446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.587714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.588791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] RBAC: Authorizing `identity:get_project(project_id=29f32d1159ff499bacab4522bdd79692)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:38.589855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 402/817] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:38.590203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:38.596688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 416/818] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:56:38 2022] GET /identity/v3/projects/29f32d1159ff499bacab4522bdd79692 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:38.597750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.693757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9f0bc-1fed-47a4-91ea-247d1e415006 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.726440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.727098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.727380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.727651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692/users/5dddedddc2e14df684ad49e8e64f6a25/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:38.729526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] RBAC: Authorizing `identity:create_grant(project_id=29f32d1159ff499bacab4522bdd79692, user_id=5dddedddc2e14df684ad49e8e64f6a25, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:38.730951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:38.733112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:38.744372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 403/819] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:38 2022] PUT /identity/v3/projects/29f32d1159ff499bacab4522bdd79692/users/5dddedddc2e14df684ad49e8e64f6a25/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:38.858339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:38.960119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5865-f841-44f7-9ee3-471ca6391e17 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:38.972332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:38.992722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:38.993344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:38.993621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:38.993890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.004702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:39.009370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:39.010277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:39.011134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 417/820] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Oct 22 23:56:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:39.017023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.114325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88abe4-084b-468e-b415-20b4c7ed74dc None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.147110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.147714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.147986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.148252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.148892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:39.149185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.150526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:39.158804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 404/821] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:39.164904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.264301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de6ec-7d4b-43a3-a02f-721f32cc31e5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.296496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.297116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.297905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.298175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.308648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.310065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:39.324340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:39.325418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:39.326434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:39.326434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:39.326434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:39.326434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 418/822] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:39.331135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.386959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:39.431590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81318dc-2252-4c44-8edd-94d32f0bd099 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.463878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.464473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.464745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.465011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.465630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:39.465928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.467293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:39.479122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 405/823] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:39.484748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.509733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:39.583238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f11e-c318-4322-8e60-18cd85099947 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.618214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.618842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.619151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.619427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.626750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.628200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:56:39.639001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:39.640072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:39.645841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 419/824] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:39.646457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.741878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab03e-6351-4f30-9733-8e72934ef6ab None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.757440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:39.774882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.775431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.775703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.775968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.776670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:39.776968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.778362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:39.795162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 406/825] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:56:39.801336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:39.882294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:39.898693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24fb56-b141-4f94-83fa-e914be134720 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:39.931862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:39.932463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:39.932741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:39.933015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:39.997678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:39.999121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.077899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:40.094468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 420/826] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:40.100250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:40.201275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cafe92-6d70-4e38-b4f6-e37ef2e3452c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:40.234441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:40.235640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.235913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.236179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.245849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:40.247282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:56:40.261308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:40.262460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:56:40.263851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:56:40.263851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:56:40.263851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:40.263851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 407/827] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:40.268074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:40.363368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811aa3b-9ce4-4f44-8018-a0fd7d0e5944 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:40.396301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:40.396908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.397182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.397452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.398080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:40.398380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:40.399747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.411358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 421/828] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:40.417146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:40.445152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:40.517541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c93f-b39e-427a-b6ea-ba2a2187ddc4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:40.553243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:40.553862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.554135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.554401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.560791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:40.562209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:56:40.573148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:40.574108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:40.575528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 408/829] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:40.580553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:40.625219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:40.677908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6484285-2b33-4f10-b6ae-b73c60e55944 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:40.709955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:40.710552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.710831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.711130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.711811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:40.712114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:40.713516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89cf1b-a96c-462c-a97c-8a811c92632a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.725061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 422/830] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:40.731423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:40.818511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:40.833236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6175cef-dd79-4d5d-9d74-6ed068b5efa2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:40.851474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1ca6-59c4-4a00-8297-bebe7be385af None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.851759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1ca6-59c4-4a00-8297-bebe7be385af None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.852036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1ca6-59c4-4a00-8297-bebe7be385af None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.853376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 423/831] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:56:40.858139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.858419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.858690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.866933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:40.867568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:40.867843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:40.868113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:40.868826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] RBAC: Adding query filter params (role.id=a54fe0bd1b414c848faf4e42c056993f, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=81aba6d76ac940dcaa33247c65cc57b0) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:40.869128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:40.870532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:40.876832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 409/832] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:40 2022] GET /identity/v3/role_assignments?user.id=81aba6d76ac940dcaa33247c65cc57b0&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=a54fe0bd1b414c848faf4e42c056993f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:40.878992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:40.880235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:40.950586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 424/833] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 23:56:41.217659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:41.318396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9d627-d0ae-4ab2-bf0e-ebdb80d2f3d4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:41.352497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:41.353131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:41.353408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:41.353677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:41.364861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:41.369638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:41.370578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:56:41.371457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 410/834] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:41.376996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:41.411280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:41.478538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa012306-87b1-474a-9e27-36e5c5b6263f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:41.513424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:41.514024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:41.514296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:41.514559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:41.515267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:41.518792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:41.518792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:41.526059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 425/835] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:41.532234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:41.545940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:41.637669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401254a-b18b-4021-a8d7-0d77ae27a267 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:41.671592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:41.672287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:41.672566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:41.672836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] PATH_INFO: `/v3/users/5dddedddc2e14df684ad49e8e64f6a25` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:41.673953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=5dddedddc2e14df684ad49e8e64f6a25)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:41.675424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:41.677000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 411/836] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:41 2022] GET /identity/v3/users/5dddedddc2e14df684ad49e8e64f6a25 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:41.683375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:41.779595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:41.785295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ba96-2198-4a2c-893f-da0e2b9860fb None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:41.817688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:41.818284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:41.818562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:41.818837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:41.881942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:41.883381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:41.969995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:41.976438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 426/837] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 22 23:56:41.982342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:42.058367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:42.079908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157058-abcf-4711-abae-2b6fea76eaf8 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:42.112166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:42.112781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:42.113056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:42.113328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:42.114424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] RBAC: Authorizing `identity:get_project(project_id=29f32d1159ff499bacab4522bdd79692)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:42.115862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c73020-3aa9-4e0c-b6ef-252a2b9d4b30 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:42.117440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 412/838] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:56:41 2022] GET /identity/v3/projects/29f32d1159ff499bacab4522bdd79692 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:42.123354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:42.216775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9cad5-b962-488f-9f48-fff766ab8156 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:42.248995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:42.249580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:42.249850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:42.250116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:42.250846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=29f32d1159ff499bacab4522bdd79692, user.id=5dddedddc2e14df684ad49e8e64f6a25) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:42.251173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:42.252567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339f69e-8b9e-46e4-ad70-01f395a43e55 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:42.258027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 427/839] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:42 2022] GET /identity/v3/role_assignments?user.id=5dddedddc2e14df684ad49e8e64f6a25&scope.project.id=29f32d1159ff499bacab4522bdd79692&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:44.366618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8ada-1f49-4a7b-bed3-9a290b70dc2b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:44.367196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8ada-1f49-4a7b-bed3-9a290b70dc2b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:44.367299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff8ada-1f49-4a7b-bed3-9a290b70dc2b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:44.368606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 413/840] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:44.373680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:44.374041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:44.374219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:44.392705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:44.393863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:44.447090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:44.458606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 428/841] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:44.730313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff8ada-1f49-4a7b-bed3-9a290b70dc2b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:44.830133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff8ada-1f49-4a7b-bed3-9a290b70dc2b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:44.862156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:44.862769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:44.863044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:44.863344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:44.864430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:44.865830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccab7-0ed2-4174-9285-5e003fe90aca None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:44.867387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 414/842] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:44.872946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:44.967180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c003b37-f400-4092-b6d0-50996b8593f3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:44.998806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:44.999364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:44.999638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:44.999904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:45.001064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:45.002450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb28bb-73bc-4cba-a467-aff85a50d295 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:45.023250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 429/843] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:56:44 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:47.159901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031416-30df-4b44-b0f4-189827ad6f9f None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:47.160420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031416-30df-4b44-b0f4-189827ad6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:47.160420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031416-30df-4b44-b0f4-189827ad6f9f None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:47.161766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 415/844] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:47.166766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:47.167213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:47.167340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:47.186425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:47.187625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:47.227183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:47.251318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 430/845] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:47.517973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c031416-30df-4b44-b0f4-189827ad6f9f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:47.648163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:47.730590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c031416-30df-4b44-b0f4-189827ad6f9f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:47.762896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:47.763531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:47.763803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:47.764069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] PATH_INFO: `/v3/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:47.765403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] RBAC: Authorizing `identity:get_role(role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:47.767329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:47.768676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 416/846] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:47 2022] GET /identity/v3/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 223 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:47.774528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:47.867165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486937-b6cc-4ef0-8c7d-e279056027df None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:47.899385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:47.899989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:47.900262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:47.900528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] PATH_INFO: `/v3/users/dff03b5873724ade9c73932639d4d47a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:47.912841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] RBAC: Authorizing `identity:get_user(user_id=dff03b5873724ade9c73932639d4d47a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:47.914241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:47.915805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 431/847] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:47 2022] GET /identity/v3/users/dff03b5873724ade9c73932639d4d47a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:47.921267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:47.998551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:48.017240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6359-86db-455d-9d41-28f19ce2b1fe None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:48.049263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:48.049814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:48.050085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:48.050351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:48.051457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] RBAC: Authorizing `identity:get_project(project_id=29f32d1159ff499bacab4522bdd79692)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:48.053118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41e91f-61c9-4b2f-92ef-1b1160e1cde7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:48.054687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 417/848] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:56:47 2022] GET /identity/v3/projects/29f32d1159ff499bacab4522bdd79692 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:48.060403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:48.092856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:48.154651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b39ec-70da-496e-8234-27d06da7ebf8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:48.186722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:48.187387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:48.188211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:48.188486 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692/users/dff03b5873724ade9c73932639d4d47a/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:48.190550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] RBAC: Authorizing `identity:create_grant(project_id=29f32d1159ff499bacab4522bdd79692, user_id=dff03b5873724ade9c73932639d4d47a, role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:48.191967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e293c-42bb-408c-9ae3-a62b734ecc1a None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:48.204379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 432/849] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:56:48 2022] PUT /identity/v3/projects/29f32d1159ff499bacab4522bdd79692/users/dff03b5873724ade9c73932639d4d47a/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:56:50.285941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad29f-6c1d-4535-836a-a7bee2c825bf None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:50.286463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad29f-6c1d-4535-836a-a7bee2c825bf None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:50.286463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad29f-6c1d-4535-836a-a7bee2c825bf None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:50.287822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 418/850] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:50.292971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:50.293374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:50.293510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:50.312164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:50.313400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:50.375945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 433/851] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:50.643947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad29f-6c1d-4535-836a-a7bee2c825bf None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:50.740141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad29f-6c1d-4535-836a-a7bee2c825bf None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:50.772521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:50.773135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:50.773407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:50.773675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] PATH_INFO: `/v3/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:50.775045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] RBAC: Authorizing `identity:get_role(role_id=f0c9ae155e4a4f5396e10ba52fbbf9b5)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:50.776408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:50.777687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 419/852] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:50 2022] GET /identity/v3/roles/f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:50.783721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:50.807810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:50.879904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb573df-e999-47d5-aaf8-9dfe0c507dc2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:50.911890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:50.912442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:50.912715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:50.912984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] PATH_INFO: `/v3/users/dff03b5873724ade9c73932639d4d47a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:50.914070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] RBAC: Authorizing `identity:get_user(user_id=dff03b5873724ade9c73932639d4d47a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:50.915503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:50.917032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 434/853] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:50 2022] GET /identity/v3/users/dff03b5873724ade9c73932639d4d47a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:50.923443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:50.942247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:51.019733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c317a-e5fa-4f81-a93e-7dcb91403ef4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:51.053150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:51.053744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:51.054020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:51.054292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:51.118514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:51.119953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:51.136539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:51.215313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 420/854] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:56:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:56:51.221658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:51.307913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:51.317007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47f0f-a5a0-4190-b3eb-f217bcb9cf4b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:51.350711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:51.351348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:51.351622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:51.351888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] PATH_INFO: `/v3/projects/29f32d1159ff499bacab4522bdd79692` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:51.352984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=29f32d1159ff499bacab4522bdd79692)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:51.354364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e80cb-9479-481f-b03c-058e6bf15fd7 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:51.355970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 435/855] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:56:51 2022] GET /identity/v3/projects/29f32d1159ff499bacab4522bdd79692 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:51.362279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:51.459040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce078-9a4f-4281-b3e2-1c94c28aa20d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:51.475691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:51.492231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:51.492825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:51.493103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:51.493375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:51.494084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] RBAC: Adding query filter params (role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5, scope.project.id=29f32d1159ff499bacab4522bdd79692, user.id=dff03b5873724ade9c73932639d4d47a) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:51.494390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:51.495827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e88bd4-6ef3-4152-8de8-ccd0c6b16b2b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:51.501916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 421/856] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:56:51 2022] GET /identity/v3/role_assignments?user.id=dff03b5873724ade9c73932639d4d47a&scope.project.id=29f32d1159ff499bacab4522bdd79692&role.id=f0c9ae155e4a4f5396e10ba52fbbf9b5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:53.613072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f202-8250-4b7e-9f6e-5732b62c9fe7 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:53.613557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f202-8250-4b7e-9f6e-5732b62c9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:53.613645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f202-8250-4b7e-9f6e-5732b62c9fe7 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:53.614943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 436/857] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:53.620071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:53.620500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:53.620602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:53.638241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:53.639473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:53.704737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 422/858] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:53.972207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f202-8250-4b7e-9f6e-5732b62c9fe7 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:54.069874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f202-8250-4b7e-9f6e-5732b62c9fe7 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:54.101161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:54.101767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:54.102039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:54.102305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:54.103406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:54.104790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b196557-5350-4b6a-b88d-713c56369a16 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:54.106296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 437/859] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:54.112370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:54.207182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac010a6-4752-4ae6-b94a-7a7472c9665e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:54.219678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:54.240522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:54.241065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:54.241340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:54.241609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:54.242252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:54.243697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e472b3-1c96-4fea-a306-5201a0d0be50 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:54.269194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 423/860] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:56:54 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:56.421222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db015-371c-41a1-b775-b3658972702f None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:56.421736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db015-371c-41a1-b775-b3658972702f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:56.421843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079db015-371c-41a1-b775-b3658972702f None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:56.423634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 438/861] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:56.429031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:56.429469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:56.429562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:56.448011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:56.449170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:56.512456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 424/862] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:56.780351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db015-371c-41a1-b775-b3658972702f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:56.808828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:56.879575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079db015-371c-41a1-b775-b3658972702f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:56.911962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:56.912575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:56.912853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:56.913126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:56.914222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:56.915663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58099aa-5c94-4822-a216-1fb21ae43117 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:56.917198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 439/863] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:56.922895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:57.012238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:57.020092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3734d2-0733-4435-ba24-f42cff7d1912 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:57.053589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:57.054142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:57.054424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:57.054698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:57.055374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:57.056791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c422c99-6a52-461b-8b3d-997b66462127 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:57.077266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 425/864] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:56:56 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:56:59.205264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9fa06-9a38-4f5e-84b7-05e9e6e302f1 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:59.205787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9fa06-9a38-4f5e-84b7-05e9e6e302f1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:59.205787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9fa06-9a38-4f5e-84b7-05e9e6e302f1 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:59.207155 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 440/865] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:56:59.212272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:59.212630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:59.212807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:59.230792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:56:59.232015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:56:59.294865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 426/866] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:56:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:56:59.560322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9fa06-9a38-4f5e-84b7-05e9e6e302f1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:59.651137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:59.658546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9fa06-9a38-4f5e-84b7-05e9e6e302f1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:59.691804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:59.692422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:59.692700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:59.692971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:59.702805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:56:59.707637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:56:59.708676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:56:59.709619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 441/867] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:56:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:56:59.714692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:59.791280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:56:59.810956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f81a3-d1a3-446b-b9c7-6980d28032d2 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:59.842628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:59.843243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:59.843518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:59.844283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:56:59.844965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:56:59.845260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:56:59.846597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:56:59.854230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 427/868] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:56:59.860518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:56:59.956981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839197e-ecc9-4dde-8f3a-f50da60d8046 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:56:59.989383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:56:59.989986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:56:59.990265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:56:59.990543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] PATH_INFO: `/v3/users/247b9e0c327c4df082ebb98774056d3f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:00.003504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=247b9e0c327c4df082ebb98774056d3f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:00.004922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:00.006468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 442/869] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:56:59 2022] GET /identity/v3/users/247b9e0c327c4df082ebb98774056d3f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:00.011976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:00.107912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8eee-7db7-41d2-a6dd-676a193a93d5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:00.140483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:00.141117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:00.141395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:00.141668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] PATH_INFO: `/v3/projects/3667c32816274adca708fe710a29bba1` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:00.142756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] RBAC: Authorizing `identity:get_project(project_id=3667c32816274adca708fe710a29bba1)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:00.144181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ab28d-f3c0-4435-960a-6904b50a7580 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:00.145763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 428/870] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:57:00 2022] GET /identity/v3/projects/3667c32816274adca708fe710a29bba1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:00.151390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:00.166369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:00.247737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7f52-bde0-4ad1-954c-5a564f1dc8e8 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:00.280981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:00.281621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:00.281899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:00.282180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] PATH_INFO: `/v3/projects/3667c32816274adca708fe710a29bba1/users/247b9e0c327c4df082ebb98774056d3f/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:00.284063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] RBAC: Authorizing `identity:create_grant(project_id=3667c32816274adca708fe710a29bba1, user_id=247b9e0c327c4df082ebb98774056d3f, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:00.285480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564be6d-ee6a-4e48-bd53-a4571960c018 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:00.297888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 443/871] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:57:00 2022] PUT /identity/v3/projects/3667c32816274adca708fe710a29bba1/users/247b9e0c327c4df082ebb98774056d3f/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:57:02.397202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9805-03a7-48e6-ae77-92c7c056d03a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:02.400175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9805-03a7-48e6-ae77-92c7c056d03a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:02.400175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9805-03a7-48e6-ae77-92c7c056d03a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:02.400175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 429/872] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:57:02.404443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:02.404852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:02.404980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:02.423316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:02.424475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:02.487529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 444/873] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:02.755488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9805-03a7-48e6-ae77-92c7c056d03a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:02.768592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:02.853957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9805-03a7-48e6-ae77-92c7c056d03a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:02.886043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:02.886654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:02.886930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:02.887233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:02.897915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:57:02.902621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:57:02.903903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:57:02.905046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 430/874] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:57:02.909608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:02.912668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:03.004133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879883a-961e-4a54-8782-1f123794a8cd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:03.036180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:03.036719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:03.036997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:03.037268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:03.037925 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:57:03.038223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:03.039613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:03.047755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 445/875] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:03.053753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:03.120392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:03.151194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c083-4086-4335-a9ed-b05ef4c58d45 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:03.184198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:03.184813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:03.185088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:03.185359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] PATH_INFO: `/v3/users/247b9e0c327c4df082ebb98774056d3f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:03.186458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] RBAC: Authorizing `identity:get_user(user_id=247b9e0c327c4df082ebb98774056d3f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:03.188441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:03.189992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 431/876] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:57:03 2022] GET /identity/v3/users/247b9e0c327c4df082ebb98774056d3f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:57:03.195700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:03.258391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:03.291716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98949c39-634c-4150-ad64-a6f1c2fa28dd None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:03.324040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:03.324630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:03.324909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:03.325183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:03.388934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:03.390345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:03.450388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:03.485105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 446/877] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:57:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:57:03.490858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:03.588418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18c24-5526-43ed-9dd8-9acf36cfba2b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:03.621475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:03.622095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:03.622373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:03.622646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] PATH_INFO: `/v3/projects/3667c32816274adca708fe710a29bba1` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:03.623779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] RBAC: Authorizing `identity:get_project(project_id=3667c32816274adca708fe710a29bba1)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:03.625224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba68d2b-d4d3-45fc-b0ea-e7b852acc992 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:03.626879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 432/878] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:57:03 2022] GET /identity/v3/projects/3667c32816274adca708fe710a29bba1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:03.632976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:03.727779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d113-dac9-4be6-8ff5-361aff923e16 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:03.760140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:03.760728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:03.761011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:03.761278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:03.761981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=3667c32816274adca708fe710a29bba1, user.id=247b9e0c327c4df082ebb98774056d3f) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:57:03.762283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:03.763723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb26e2-b497-4325-9fb6-b6f0667397ee None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:03.769260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 447/879] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:57:03 2022] GET /identity/v3/role_assignments?user.id=247b9e0c327c4df082ebb98774056d3f&scope.project.id=3667c32816274adca708fe710a29bba1&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:05.886172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112cd6b-95a5-4cb2-8ecd-6769b2e6ea87 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:05.886708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112cd6b-95a5-4cb2-8ecd-6769b2e6ea87 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:05.886708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112cd6b-95a5-4cb2-8ecd-6769b2e6ea87 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:05.888060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 433/880] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:57:05.893710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666791-413e-4233-b99d-eee14a053f12 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:05.894087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666791-413e-4233-b99d-eee14a053f12 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:05.894267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666791-413e-4233-b99d-eee14a053f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:05.912615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-36666791-413e-4233-b99d-eee14a053f12 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:05.913797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-36666791-413e-4233-b99d-eee14a053f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:05.936414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:05.978325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 448/881] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:06.243905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112cd6b-95a5-4cb2-8ecd-6769b2e6ea87 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:06.253606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:06.344068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112cd6b-95a5-4cb2-8ecd-6769b2e6ea87 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:06.376543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:06.377128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:06.377401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:06.377666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:06.378319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:06.379685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357155f-d0e1-40c3-b9fe-0aa54f0c2d52 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:06.394722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 434/882] 10.222.0.20 () {60 vars in 1138 bytes} [Sat Oct 22 23:57:06 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:57:08.545138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70579-9297-4d98-9c42-7bc8ec364a93 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:08.545613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70579-9297-4d98-9c42-7bc8ec364a93 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:08.545712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70579-9297-4d98-9c42-7bc8ec364a93 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:08.547018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 449/883] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 23:57:08.552663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:08.553097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:08.553184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:08.574928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:08.576200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:08.636558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:08.647288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 435/884] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:08.915152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d70579-9297-4d98-9c42-7bc8ec364a93 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:09.011037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d70579-9297-4d98-9c42-7bc8ec364a93 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:09.042924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:09.043553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:09.043826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:09.044092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] PATH_INFO: `/v3/domains/960de610499e44d48899b27d7bdb86d6` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:09.054794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=960de610499e44d48899b27d7bdb86d6)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:09.056239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1418f-cc2c-4b3f-ba72-9d07b389e62d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:09.057757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 450/885] 10.222.0.20 () {56 vars in 1183 bytes} [Sat Oct 22 23:57:08 2022] GET /identity/v3/domains/960de610499e44d48899b27d7bdb86d6 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:09.063961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:09.158087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429fb58-d31d-40c4-afa5-8ee6593b86d0 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:09.192026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:09.192556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:09.192828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:09.193092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:09.193732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:09.195270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28543fa4-b3f8-4ec5-9447-06b14d1ef621 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:09.220213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 436/886] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:57:09 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:57:11.385847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1feada-5f68-4e65-8303-9fa1d35d74eb None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:11.386480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1feada-5f68-4e65-8303-9fa1d35d74eb None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:11.386480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1feada-5f68-4e65-8303-9fa1d35d74eb None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:11.387742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 451/887] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:57:11.393438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:11.393818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:11.393996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:11.412426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:11.413613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:11.455915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:11.479254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 437/888] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:11.748376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1feada-5f68-4e65-8303-9fa1d35d74eb None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:11.770054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:11.846073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1feada-5f68-4e65-8303-9fa1d35d74eb None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:11.878206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:11.878819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:11.879113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:11.879386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] PATH_INFO: `/v3/domains/960de610499e44d48899b27d7bdb86d6` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:11.880468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=960de610499e44d48899b27d7bdb86d6)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:11.881858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20430d83-f69b-4a39-8c2e-e183280985bf None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:11.883436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 452/889] 10.222.0.20 () {56 vars in 1183 bytes} [Sat Oct 22 23:57:11 2022] GET /identity/v3/domains/960de610499e44d48899b27d7bdb86d6 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:11.889180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:11.985066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7211ba1-61d9-48a6-b791-1ce32c5e0c68 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:12.017136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:12.017677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:12.017957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:12.018231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:12.018877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:12.020329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08b8f-c5d4-4c33-b936-b96a37ff245b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:12.040650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 438/890] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:57:11 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:57:14.175790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71ad36-7b4c-406b-8ff5-9f8601b94527 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:14.176336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71ad36-7b4c-406b-8ff5-9f8601b94527 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:14.176336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71ad36-7b4c-406b-8ff5-9f8601b94527 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:14.177910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 453/891] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:57:14.183148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:14.183537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:14.183690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:14.201281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:14.202446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:14.228304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:14.267525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 439/892] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:14.534048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71ad36-7b4c-406b-8ff5-9f8601b94527 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:14.618701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:14.631250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71ad36-7b4c-406b-8ff5-9f8601b94527 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:14.663317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:14.663929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:14.664205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:14.664476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:14.674216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:57:14.679262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:57:14.680393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:57:14.681639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 454/893] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:57:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:57:14.686378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:14.781553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c54ac-e191-47c8-903d-0db6396346b9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:14.814663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:14.815277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:14.815554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:14.815823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:14.816469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:57:14.816768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:14.818101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:14.825829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 440/894] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:14.831881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:14.926546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d282b6-a191-4043-b2f5-c9930130166e None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:14.959085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:14.959766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:14.960043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:14.960316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] PATH_INFO: `/v3/users/fcbb299d90964d9e84e217e44c6750f4` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:14.973789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] RBAC: Authorizing `identity:get_user(user_id=fcbb299d90964d9e84e217e44c6750f4)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:14.975228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:14.976778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 455/895] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:57:14 2022] GET /identity/v3/users/fcbb299d90964d9e84e217e44c6750f4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:14.982508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:15.009687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:15.080134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe650569-4ec6-41b8-bc74-43e7990b26cb None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:15.112113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:15.112731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:15.113007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:15.113280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] PATH_INFO: `/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:15.114380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] RBAC: Authorizing `identity:get_project(project_id=a41f0f9fbbda474c91ffbbe06781cbc2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:15.115812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b649fc7-4b43-42dd-a0f7-7d1bd8323000 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:15.117404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 441/896] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:57:14 2022] GET /identity/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:57:15.123168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:15.131679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:15.331609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86b20-2ec0-493d-b6b4-cd90bcc8a30d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:15.363022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:15.363678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:15.363948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:15.364213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] PATH_INFO: `/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2/users/fcbb299d90964d9e84e217e44c6750f4/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:15.366029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a41f0f9fbbda474c91ffbbe06781cbc2, user_id=fcbb299d90964d9e84e217e44c6750f4, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:15.367467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ee16a-a6d3-4160-a55c-1938bbc600c1 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:15.379682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 456/897] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:57:15 2022] PUT /identity/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2/users/fcbb299d90964d9e84e217e44c6750f4/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:57:17.487371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55dde-9be4-4e40-b1fc-cb318f8ec39d None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:17.487915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55dde-9be4-4e40-b1fc-cb318f8ec39d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:17.487915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55dde-9be4-4e40-b1fc-cb318f8ec39d None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:17.489243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 442/898] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:57:17.494332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:17.494758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:17.494858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:17.513002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:57:17.514164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:57:17.570678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:17.578902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 457/899] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:57:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:57:17.844638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55dde-9be4-4e40-b1fc-cb318f8ec39d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:17.936462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:17.944109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55dde-9be4-4e40-b1fc-cb318f8ec39d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:17.976476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:17.977095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:17.977370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:17.977638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:17.988560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:57:17.993254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:57:17.994289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:57:17.995503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 443/900] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:57:18.000309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:18.094162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec87b-b209-4c12-a020-598a04f3393c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:18.125525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:18.126054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:18.126328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:18.126599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:18.127275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:57:18.127575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:18.128897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:18.136523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 458/901] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:18.142627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:18.239666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a07cf4-a5fa-4f13-b1a3-e7f5f0f29af5 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:18.271878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:18.272492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:18.272767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:18.273035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] PATH_INFO: `/v3/users/fcbb299d90964d9e84e217e44c6750f4` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:18.274132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] RBAC: Authorizing `identity:get_user(user_id=fcbb299d90964d9e84e217e44c6750f4)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:18.275570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:18.277108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 444/902] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Oct 22 23:57:18 2022] GET /identity/v3/users/fcbb299d90964d9e84e217e44c6750f4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:18.283492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:18.339183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:18.378422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedff27-623e-45dd-9dd5-ea0ec99a7089 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:18.410677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:18.411291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:18.411567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:18.411834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:18.475039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:18.476479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:18.529872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:18.571810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 459/903] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:57:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:57:18.578211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:18.602160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:18.674932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791ed7-fbc7-444a-8a15-da51d9cd8924 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:18.708028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:18.708642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:18.708920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:18.709192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] PATH_INFO: `/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:18.710305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] RBAC: Authorizing `identity:get_project(project_id=a41f0f9fbbda474c91ffbbe06781cbc2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:18.711739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e7493-7d5e-42c6-a176-fe8e5a4b728c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:18.713340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 445/904] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Oct 22 23:57:18 2022] GET /identity/v3/projects/a41f0f9fbbda474c91ffbbe06781cbc2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:18.719360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:57:18.813038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf745e8-12da-4d3c-905a-1f0177de7167 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:57:18.844129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:57:18.844705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:57:18.844974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:57:18.845238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:57:18.845934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=a41f0f9fbbda474c91ffbbe06781cbc2, user.id=fcbb299d90964d9e84e217e44c6750f4) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:57:18.846235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:57:18.847657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86145475-c6df-4f94-8e1a-bdfa38d2bd60 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:57:18.853028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 460/905] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:57:18 2022] GET /identity/v3/role_assignments?user.id=fcbb299d90964d9e84e217e44c6750f4&scope.project.id=a41f0f9fbbda474c91ffbbe06781cbc2&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:57:28.703953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=55 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:57:28.850538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:14.030669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace3a0-ac50-47f2-a315-14c273b74191 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:14.031434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace3a0-ac50-47f2-a315-14c273b74191 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:14.031434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ace3a0-ac50-47f2-a315-14c273b74191 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:14.032768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 446/906] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:14.038273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:14.038746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:14.038841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:14.063499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:14.065026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:14.146824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 461/907] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:14.437489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ace3a0-ac50-47f2-a315-14c273b74191 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:14.571035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ace3a0-ac50-47f2-a315-14c273b74191 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:14.621282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:14.621603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:14.623439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:14.623439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:14.637781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:14.639693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:14.656501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:14.657560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:14.658521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:14.658521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:14.658521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:14.658521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 447/908] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:58:14.663977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:14.787249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d87f6-7c3c-4b9f-a313-327a188dd2f3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:14.830068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:14.836789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:14.837399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:14.837678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:14.837952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:14.838593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:14.838895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:14.840609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2176-51a0-4493-997b-0623c8f8f99f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:14.859376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 462/909] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:58:14.861428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:14.928306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:14.996131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd453b-d4ff-4273-b354-7076d74fa06d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:15.040811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:15.041442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:15.041835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:15.042112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:15.042909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:15.044363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399d42e-5387-43ec-bc90-fd7069dc62b2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:15.079537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 448/910] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Oct 22 23:58:14 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:58:17.543610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d6b6-b93d-40c2-9697-5041edcdf756 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:17.544185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d6b6-b93d-40c2-9697-5041edcdf756 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:17.544185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914d6b6-b93d-40c2-9697-5041edcdf756 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:17.545526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 463/911] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:17.552075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:17.552075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:17.552954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:17.573245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:17.574432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:17.653561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 449/912] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:17.957280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d6b6-b93d-40c2-9697-5041edcdf756 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:18.068827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914d6b6-b93d-40c2-9697-5041edcdf756 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:18.106830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:18.107511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:18.108313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:18.108313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:18.119153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:58:18.124220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:18.125658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:18.126515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 464/913] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:18.131287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:18.176193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:18.245873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173650f-d987-42cd-878e-9f825ae4f89d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:18.284390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:18.285053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:18.285327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:18.285591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:18.286247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] RBAC: Adding query filter params (name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:18.286540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:18.288040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:18.297154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 450/914] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:58:18.303760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:18.363886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:18.424499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e75dd-4979-4fcd-a007-8679c8d14133 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:18.470141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:18.470885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:18.471309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:18.471596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:18.483637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:18.485076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:18.500099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:18.501233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:18.502164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:18.502164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:18.502164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:18.502164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 465/915] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:18.506995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:18.631911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:18.637554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23659517-dace-46ab-9980-8e72406f8d46 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:18.678628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:18.679870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:18.681515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:18.681515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:18.682091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:18.682819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:18.684744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:18.700432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 451/916] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:18.706549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:18.824347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccebf05-5351-4cdf-aa6f-336e1eeafef5 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:18.826337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:18.865092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:18.865804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:18.866112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:18.866383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] PATH_INFO: `/v3/users/placement` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:18.875853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:18.877775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:58:18.890808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:18.892002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:18.893152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:18.895021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 466/917] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:18.900859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.044145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c641ec-0c26-411c-a3a8-3fc21e86679c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:19.088726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:19.089402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:19.089732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:19.090141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:19.091160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:19.092065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:19.093900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:19.115495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 452/918] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Oct 22 23:58:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:58:19.122643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.241413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd47f9-055f-4144-b847-89ae7b3d81da None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:19.279454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:19.280084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:19.280358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:19.280629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:19.292696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:19.294112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:19.311392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:19.312381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:19.313259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:19.313259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:19.313259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:19.318001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 467/919] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:19.319126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.348564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:19.436546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4deed-dc4c-4f81-aedc-5593f9ba5edb None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:19.474142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:19.475144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:19.475614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:19.476075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:19.476905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:19.477492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:19.479143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:19.496685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 453/920] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 23:58:19.502809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.527493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:19.628520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70b2f4-312a-44f4-9b08-2767f17cbd92 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:19.676915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:19.677824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:19.678165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:19.678450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:19.686112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:19.687727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:58:19.700018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:19.701715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:19.702600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 468/921] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:19.708185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.806332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:19.836455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b6ce6-b5eb-4e1f-b77d-761f5fe67c5c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:19.880205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:19.880840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:19.881119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:19.881438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:19.882144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:19.882471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:19.884059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387620cf-f570-4b01-984f-2e12cbe73707 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:19.898069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 454/922] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:19.904725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:19.990148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:20.017739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22a7d9-fbe8-48d0-9fc9-5ff065161a4f None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:20.061916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:20.062642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:20.062878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:20.063160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/f066868b0a2c422590c58d763734380f/roles/f93f9a8f24e4494696cd163aa982e3af` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:20.082165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=f066868b0a2c422590c58d763734380f, role_id=f93f9a8f24e4494696cd163aa982e3af)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:20.083728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a4600-77df-40fc-9a9e-a55d5891841d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:20.101096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 469/923] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:58:19 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/f066868b0a2c422590c58d763734380f/roles/f93f9a8f24e4494696cd163aa982e3af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 23:58:22.268643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03afa-9a4d-4c85-8de6-fec7998a5c59 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:22.269187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03afa-9a4d-4c85-8de6-fec7998a5c59 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:22.269187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03afa-9a4d-4c85-8de6-fec7998a5c59 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:22.270535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 455/924] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:22.275854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:22.276277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:22.276384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:22.293983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:22.295251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:22.365049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 470/925] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:22.683416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03afa-9a4d-4c85-8de6-fec7998a5c59 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:22.802585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03afa-9a4d-4c85-8de6-fec7998a5c59 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:22.840833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:22.841997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:22.842275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:22.842598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:22.849291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:22.853899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:58:22.858657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:22.863156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:22.864161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 456/926] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Oct 22 23:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:22.865824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:22.924651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:22.973363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbcda4-fece-4beb-b7f3-9071b1b98efb None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.010339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.010918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.011235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.011577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.012309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:23.012699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:23.014270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:23.024036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 471/927] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Oct 22 23:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:23.030550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:23.149818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8533b-c3ba-4952-9431-e1c81a27ba0a None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.190752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.191393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.191810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.192054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.204778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:23.206350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:23.222642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:23.223865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:23.225106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:23.225106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:23.225106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:23.230822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 457/928] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:23.230960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:23.340155 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce34c9-c352-40be-bd76-f14939cd4d4c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.357763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:23.376567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.377167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.377445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.377714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.378389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:23.378673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:23.380054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:23.392024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 472/929] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:23.397995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:23.459426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:23.527505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f74d-df15-482a-89ea-7399aa6b9c3c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.564580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.565225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.565509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.565769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.573656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:23.575150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:58:23.587055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:23.588835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:23.590467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 458/930] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:23.598806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:23.707587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086903-069b-4c06-990b-b65f2f511fc9 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.746567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.747308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.748093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.748365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.749232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:23.749565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:23.751108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:23.771418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 473/931] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Oct 22 23:58:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:23.777597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:23.888143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4906e-a327-4ba8-b1f8-e9459240d729 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:23.898948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:23.922530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:23.923170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:23.923448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:23.923717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:23.998772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.000384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.109637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 459/932] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:58:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:58:24.115845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:24.150878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:24.229812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9626-da42-421e-a8a5-3c75faef2609 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:24.270038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:24.270575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:24.270873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:24.271184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:24.282636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.284135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:24.299539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:24.300669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:24.301743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:24.301743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:24.301743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:24.301743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 474/933] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:58:24.306925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:24.319318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:24.413272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ad4d6-6eca-4772-8e73-8ecb1b3db67d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:24.450332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:24.451516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:24.451795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:24.452068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:24.452712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:24.453082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.454419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.465848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 460/934] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:24.472152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:24.567815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:24.584109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb926-9c6c-4842-936d-28eecb833e50 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:24.621015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:24.621601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:24.621880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:24.622144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:24.629133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.630576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:58:24.642206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:24.643359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:24.644430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 475/935] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:24.649929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:24.730913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:24.766663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21b218-5d39-44d2-820d-2551c5c1464d None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:24.803060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:24.803624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:24.803899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:24.804167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:24.804844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:24.805143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.806547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff66e0-249a-4db9-91d7-b0182fed8c27 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.819171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 461/936] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:24.826622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:24.935758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395bee4-3f8e-48c7-971b-7334b34c85cb None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:24.972586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:24.973199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:24.973473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:24.973745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:24.974459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] RBAC: Adding query filter params (role.id=f93f9a8f24e4494696cd163aa982e3af, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=f066868b0a2c422590c58d763734380f) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:24.974812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:24.976330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923646-6db4-4283-9b13-97d4c610b593 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:24.983219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 476/937] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:58:24 2022] GET /identity/v3/role_assignments?user.id=f066868b0a2c422590c58d763734380f&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=f93f9a8f24e4494696cd163aa982e3af => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:27.351693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9d4-0eab-490f-879c-cf406566f4af None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:27.352263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9d4-0eab-490f-879c-cf406566f4af None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:27.352263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9d4-0eab-490f-879c-cf406566f4af None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:27.353662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 462/938] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:27.358686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:27.359112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:27.359258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:27.379682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:27.380865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:27.383735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:27.457936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 477/939] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:27.738955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc9d4-0eab-490f-879c-cf406566f4af None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:27.850895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc9d4-0eab-490f-879c-cf406566f4af None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:27.881617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:27.888483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:27.889123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:27.889403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:27.889674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:27.899631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:58:27.904954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:27.905945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:27.906805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 463/940] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:58:27.913766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.021428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e1d46-2660-4bbf-b70d-7a3ba48a50f5 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.065455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.066193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.066530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.066837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.067620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:28.067946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.069482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:28.078058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 478/941] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:28.084244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.206085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0665a7-3751-436a-bc3b-63a596ea3ae4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.245102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.245762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.246060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.246353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.257860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.259357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:28.275010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:28.276114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:28.277040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:28.277040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:28.277040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:28.277040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 464/942] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:28.282588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.285521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:28.394300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b3d6-ef0d-4cfb-93e0-cbb8548a2b76 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.430338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.430936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.431246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.431518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.432147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:28.432442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.433777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:28.448497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 479/943] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:28.455827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.506190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:28.577316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed30c-4345-4b37-a5dd-87513c90df7b None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.614045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.614904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.615302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.615578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.623190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.624632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:58:28.636718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:28.643138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:28.644332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 465/944] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:28.645265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.710841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:28.753725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd983f85-be3a-4630-aed6-a687464c3ee2 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.791035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.791788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.792064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.792410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.793203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:28.793543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.795708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:28.815401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 480/945] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Oct 22 23:58:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:28.822165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:28.945773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5009b-229c-47d3-a282-ca4cea8ede76 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:28.947270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:28.985464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:28.986092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:28.986373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:28.986640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:28.998302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:28.999781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:29.016055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:29.017221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:29.018421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:29.018421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:29.018421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:29.018421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 466/946] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:58:29.023791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:29.132556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887c30-899f-4a88-b2e8-4cd3c631d02b None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:29.153293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:29.168927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:29.170086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:29.170358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:29.170630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:29.171290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:29.171589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:29.172970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:29.186246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 481/947] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:29.192063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:29.312548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118824c0-76e6-468a-b4d1-d6eb414967a7 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:29.349071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:29.349710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:29.349994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:29.350253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:29.357204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:29.358634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:58:29.369797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:29.370691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:29.371628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 467/948] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 23:58:29.377213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:29.488569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdbaed-a8b7-403b-8f4a-7867e3916e74 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:29.530361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:29.530971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:29.531276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:29.531545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:29.532233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:29.532536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:29.533959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb065a1-80f5-4dd8-9123-3d5f1fef97a3 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:29.547692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 482/949] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:29.554288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:29.573658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:29.677826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c588c6-187d-4f38-b540-c56d79878f30 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:29.719345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:29.720001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:29.720305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:29.720730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] PATH_INFO: `/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/f066868b0a2c422590c58d763734380f/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:29.723326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80505c9a36a4dee9330754fb31d81b3, user_id=f066868b0a2c422590c58d763734380f, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:29.725224 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4b853-3ac5-4430-af6e-6d33ca2900e8 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:29.739814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 468/950] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Oct 22 23:58:29 2022] PUT /identity/v3/projects/a80505c9a36a4dee9330754fb31d81b3/users/f066868b0a2c422590c58d763734380f/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 23:58:32.213914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0d246-af0a-4840-8a5b-db97451806f0 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:32.214519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0d246-af0a-4840-8a5b-db97451806f0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:32.214519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0d246-af0a-4840-8a5b-db97451806f0 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:32.216187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 483/951] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:32.221669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:32.222337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:32.222337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:32.241206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:32.242383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:32.313149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 469/952] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:32.580309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0d246-af0a-4840-8a5b-db97451806f0 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:32.626488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:32.687412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0d246-af0a-4840-8a5b-db97451806f0 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:32.725089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:32.725717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:32.725995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:32.726270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:32.738733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 23:58:32.743781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:32.744875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:32.745767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 484/953] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Oct 22 23:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:32.751241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:32.754364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:32.860334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ab513-9214-44dd-bde4-f8e89e622b92 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:32.897541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:32.898227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:32.898571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:32.898899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:32.899700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:32.900067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:32.901555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:32.911909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 470/954] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Oct 22 23:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:32.918397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:33.023975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:33.027169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770472b9-6a90-4ed3-bce9-f2e76615f542 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:33.067610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:33.068244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:33.068519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:33.068789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:33.080842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:33.082297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:33.098128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:33.099357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:33.100305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:33.100305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:33.100305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:33.100305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 485/955] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:33.105167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:33.176496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:33.225729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31853e-a3b4-4e68-93e5-4f49fff0f3b2 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:33.260262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:33.260887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:33.261164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:33.261438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:33.262085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:33.262386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:33.264289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:33.278110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 471/956] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:33.284626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:33.388407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ef7d8-cb05-4b20-bdab-af1d5abd6790 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:33.422523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:33.423170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:33.423447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:33.423714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:33.431534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:33.432878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 23:58:33.444365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:33.445510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:33.446659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 486/957] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:33.452070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:33.553087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82666d11-da3f-410b-969a-de1ad345f569 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:33.580621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:33.589894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:33.590510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:33.590786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:33.591103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:33.591839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:33.592143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:33.593556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:33.611107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 472/958] 10.222.0.20 () {56 vars in 1143 bytes} [Sat Oct 22 23:58:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:33.616863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:33.632793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:33.717473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a891d6d-5598-4c51-a040-f1ee3f986b3d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:33.749147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:33.749738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:33.750014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:33.750283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:33.814342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:33.815789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:33.828359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:33.909026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 487/959] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Oct 22 23:58:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 23:58:33.914797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:34.011990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da870-48d3-48da-9aa7-61be17bc03a4 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:34.044761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:34.045378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:34.045655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:34.045926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:34.055975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:34.057394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 23:58:34.071508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:34.072550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 23:58:34.073652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 23:58:34.073652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 23:58:34.073652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:34.073652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 473/960] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Oct 22 23:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:34.078475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:34.173852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c954f1-7be3-4733-8b4a-0c3cf1a6660d None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:34.188806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:34.213154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:34.213915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:34.214391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:34.214780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:34.215659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:34.216139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:34.217976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:34.229985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 488/961] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Oct 22 23:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:34.235844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:34.270884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:34.332743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683e14-4306-4180-92de-05781776f6e1 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:34.364047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:34.364655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:34.364929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:34.365193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:34.371476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:34.373400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 23:58:34.384095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:34.385124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: ERROR keystone.server.flask.application Oct 22 23:58:34.386209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 474/962] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Oct 22 23:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:34.391554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:34.485550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe7c-518a-41a4-a171-4806295885e4 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:34.516453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:34.517042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:34.517313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:34.517577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:34.518245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:34.518540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:34.520389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861a2e0-a531-444c-bf0e-f5e91a2a29e0 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:34.532598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 489/963] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Oct 22 23:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:34.538490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:34.630016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:34.636056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def6cc-4988-482b-8f95-96e832ca7f07 None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:34.668971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:34.669644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:34.669924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:34.670191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:34.670898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] RBAC: Adding query filter params (role.id=55e94c99a5d74674bcc214e7a019295d, scope.project.id=a80505c9a36a4dee9330754fb31d81b3, user.id=f066868b0a2c422590c58d763734380f) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:34.671230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:34.672624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb46e-70d7-41d5-b460-1f520a86d8d7 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:34.678390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 475/964] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Oct 22 23:58:34 2022] GET /identity/v3/role_assignments?user.id=f066868b0a2c422590c58d763734380f&scope.project.id=a80505c9a36a4dee9330754fb31d81b3&role.id=55e94c99a5d74674bcc214e7a019295d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:36.816347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee667-ccf7-4532-99c1-8def035dd146 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:36.816866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee667-ccf7-4532-99c1-8def035dd146 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:36.816866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee667-ccf7-4532-99c1-8def035dd146 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:36.818137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 490/965] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:36.823190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:36.823597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:36.823741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:36.843289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:36.844476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:36.908361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 476/966] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:37.174920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee667-ccf7-4532-99c1-8def035dd146 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:37.213930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:37.289756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee667-ccf7-4532-99c1-8def035dd146 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:37.322236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:37.322848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:37.323145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:37.323417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:37.323981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:37.325882 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:37.334295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:37.335503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:37.336525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 491/967] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:58:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:37.341497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:37.426062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:37.436515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115ab5c-d6a2-4c73-b9dd-f4c53d1cea57 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:37.468966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:37.469550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:37.469822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:37.470088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:37.470698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:37.470993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:37.472349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d13f-2168-4686-8bfb-3088a678f89a None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:37.476974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 477/968] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Oct 22 23:58:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:37.482607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:37.574079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:37.580028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cfc86-20b7-4fe9-b5e9-567e13cf5119 None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:37.612166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:37.612760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:37.613037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:37.613316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] PATH_INFO: `/v3/services` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:37.613931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:37.614234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:37.615608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62e23-df5e-4457-af45-fa6f19aeb68d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:37.619853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 492/969] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Oct 22 23:58:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:39.731312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0ca6-ab0b-497d-904c-ffcbef4f22d7 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:39.732337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0ca6-ab0b-497d-904c-ffcbef4f22d7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:39.732422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0ca6-ab0b-497d-904c-ffcbef4f22d7 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:39.733697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 478/970] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:39.738726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a705-e422-4b19-b1ff-b21631e03116 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:39.739121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a705-e422-4b19-b1ff-b21631e03116 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:39.739304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a705-e422-4b19-b1ff-b21631e03116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:39.756907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9c46a705-e422-4b19-b1ff-b21631e03116 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:39.758084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9c46a705-e422-4b19-b1ff-b21631e03116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:39.821609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 493/971] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:40.087965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c0ca6-ab0b-497d-904c-ffcbef4f22d7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:40.191496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c0ca6-ab0b-497d-904c-ffcbef4f22d7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:40.228115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:40.228658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:40.228903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:40.229172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:40.229895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:40.231227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd8e82-abaa-439f-8f35-2e20a4e18969 None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:40.247877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 479/972] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Oct 22 23:58:40 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 23:58:42.369923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7678c-6261-46fa-ae36-7c6b887a1727 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:42.370473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7678c-6261-46fa-ae36-7c6b887a1727 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:42.370473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7678c-6261-46fa-ae36-7c6b887a1727 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:42.371843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 494/973] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:42.377660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:42.378092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:42.378193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:42.395739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:42.396906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:42.406381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:42.469226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 480/974] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:42.733017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7678c-6261-46fa-ae36-7c6b887a1727 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:42.818958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:42.829820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7678c-6261-46fa-ae36-7c6b887a1727 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:42.862367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:42.862975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:42.863272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:42.863539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:42.864098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:42.865414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:42.873843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:42.874962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:42.875843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 495/975] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:58:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:42.880898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:42.976833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b025-b2e9-4611-bd54-5915fd9494f4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:43.009230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:43.009766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:43.010043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:43.010315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:43.010929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:43.011259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:43.013169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:43.018168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 481/976] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Oct 22 23:58:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:43.024072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:43.121135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ed42b-c2a2-41d1-9049-fa2fe4e6b12c None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:43.152922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:43.154081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:43.154354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:43.154620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:43.155324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] RBAC: Adding query filter params (interface=public, service_id=8c21d58ba8324832bbb47e9f8cfc3939, region_id=RegionOne) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:43.155626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:43.156962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fee0a2-e202-4e3b-9ce6-ddd3f23d982d None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:43.161731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 496/977] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Oct 22 23:58:43 2022] GET /identity/v3/endpoints?service_id=8c21d58ba8324832bbb47e9f8cfc3939&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:43.167426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:43.171163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:43.275033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8a72-36f2-4f96-a524-448201827c3c None admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:43.308674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:43.309274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:43.310062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:43.310327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:43.310913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:43.312293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0a034-7e3d-4ade-ae70-c11464b9f30e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:43.318845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 482/978] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Oct 22 23:58:43 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 23:58:45.445109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45914da-e495-4a55-8bfb-6e9acaab865a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:45.445655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45914da-e495-4a55-8bfb-6e9acaab865a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:45.445655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45914da-e495-4a55-8bfb-6e9acaab865a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:45.446973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 497/979] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:58:45.452085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:45.452519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:45.452618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:45.471379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:58:45.472546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:58:45.533216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:45.539001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 483/980] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:58:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 23:58:45.810767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45914da-e495-4a55-8bfb-6e9acaab865a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:45.830020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:45.907957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45914da-e495-4a55-8bfb-6e9acaab865a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:45.940859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:45.941473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:45.941750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:45.942018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:45.942579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:45.943936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 23:58:45.952368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 23:58:45.953606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application with Lock( Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self._enter() Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application return self.creator() Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application created_value = creator( Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: ERROR keystone.server.flask.application Oct 22 23:58:45.954607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 498/981] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Oct 22 23:58:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 23:58:45.959325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:46.055359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57822c-5db5-4eaf-85ed-b5a1f0b0af57 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:46.088135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:46.088732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:46.089011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:46.089282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] PATH_INFO: `/v3/services` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:46.089896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 23:58:46.090203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:46.091628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950da3-228b-4cd2-828f-eb5e7799d27e None admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:46.096552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 484/982] 10.222.0.20 () {56 vars in 1116 bytes} [Sat Oct 22 23:58:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 23:58:46.102078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:58:46.183631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:46.204529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6097f5-7d19-496f-8801-0a798e5910ab None admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:58:46.243585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:58:46.244394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:58:46.244788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:58:46.245184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:58:46.246201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:58:46.248054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c324c2c-8dd9-4e65-854c-9d830412ff44 None admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:58:46.266621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 499/983] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Oct 22 23:58:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 23:58:56.093619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=69 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:58:56.262599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:50.013607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdecb7b-737a-4e26-8282-b3d0d80fcb13 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:50.014188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdecb7b-737a-4e26-8282-b3d0d80fcb13 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:50.014188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdecb7b-737a-4e26-8282-b3d0d80fcb13 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:50.020915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87e7de-b07a-47b8-8958-0523a791496e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:50.021406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87e7de-b07a-47b8-8958-0523a791496e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:50.021486 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87e7de-b07a-47b8-8958-0523a791496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:50.024371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 485/984] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:59:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:59:50.204572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4b87e7de-b07a-47b8-8958-0523a791496e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:59:50.205702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4b87e7de-b07a-47b8-8958-0523a791496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:50.320624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 500/985] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 23:59:50.629168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:50.629491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:50.629725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:50.631424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 486/986] 10.222.0.20 () {54 vars in 964 bytes} [Sat Oct 22 23:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:59:50.638035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7814bb-3570-48b5-b0bb-0096185fb041 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:50.638743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7814bb-3570-48b5-b0bb-0096185fb041 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:50.639341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7814bb-3570-48b5-b0bb-0096185fb041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:50.732154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-db7814bb-3570-48b5-b0bb-0096185fb041 None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:59:50.733730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-db7814bb-3570-48b5-b0bb-0096185fb041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:50.756299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:50.820126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 501/987] 10.222.0.20 () {58 vars in 1061 bytes} [Sat Oct 22 23:59:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 23:59:50.830676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:59:50.832876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:50.964286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afa753-fa5f-462f-96f0-06101fedfe33 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:59:51.045870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:59:51.046571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:51.046859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:51.047029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:51.048633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:51.106370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:51.163164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:59:51.164625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02a5e0-77ab-4779-8a97-bcf1d5648fdb service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:59:51.187389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 487/988] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Oct 22 23:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 23:59:53.671121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:53.671622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:53.671709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:53.673020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 502/989] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:59:53.678586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd704-e638-49a5-9ced-f5c8db91991c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:53.679019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd704-e638-49a5-9ced-f5c8db91991c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:53.679283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd704-e638-49a5-9ced-f5c8db91991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:53.754202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b52bd704-e638-49a5-9ced-f5c8db91991c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:59:53.755460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b52bd704-e638-49a5-9ced-f5c8db91991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:53.853006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 488/990] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 23:59:54.134059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:59:54.136103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:54.238111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e967b-b0b3-4805-95c5-58216a280e95 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:59:54.309122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:54.311622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:59:54.312258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:54.312711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:54.313182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:54.315008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:54.421813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:59:54.423177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7b84-2189-4e7f-94be-8aa3ec2db8c5 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:59:54.440950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 503/991] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Oct 22 23:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 23:59:56.870144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:56.870645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:56.870753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:56.872053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 489/992] 10.222.0.20 () {54 vars in 927 bytes} [Sat Oct 22 23:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 23:59:56.877154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e65d2-dfe1-41a6-93bf-80d386bd01fa None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:56.877556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e65d2-dfe1-41a6-93bf-80d386bd01fa None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:56.877731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e65d2-dfe1-41a6-93bf-80d386bd01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:56.942400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-033e65d2-dfe1-41a6-93bf-80d386bd01fa None None] MFA Rules not processed for user `838fa254e7cd4455b3ba74c7bf9824ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 23:59:56.943692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-033e65d2-dfe1-41a6-93bf-80d386bd01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:56.993452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:57.037379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 504/993] 10.222.0.20 () {58 vars in 1024 bytes} [Sat Oct 22 23:59:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 23:59:57.318672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 23:59:57.320251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:57.329942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:57.423404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4c768-abcd-4106-9050-231c927a15bc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 23:59:57.495339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 23:59:57.495939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 23:59:57.496214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 23:59:57.496479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 23:59:57.498047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 23:59:57.561515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 23:59:57.608083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 23:59:57.609506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd227a8-1721-448f-b733-fa4d3df47d07 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 23:59:57.627898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 490/994] 10.222.0.20 () {60 vars in 1365 bytes} [Sat Oct 22 23:59:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:00.324280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:00.324785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:00.324785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:00.326109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 505/995] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:00.331353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399eb8-f9bb-4d13-830c-49f50c6dbd12 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:00.331749 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399eb8-f9bb-4d13-830c-49f50c6dbd12 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:00.331888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399eb8-f9bb-4d13-830c-49f50c6dbd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:00.398135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0d399eb8-f9bb-4d13-830c-49f50c6dbd12 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:00.399360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0d399eb8-f9bb-4d13-830c-49f50c6dbd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:00.493835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 491/996] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:00:00.776906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:00.778418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:00.879312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329b478-f074-4092-a1d6-973c24406d8c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:00.950520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:00.951142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:00.951424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:00.951698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:00.953261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:00.959974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:01.060565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:01.061903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5024d-3785-45fc-b352-f92278b6f223 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:01.080166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 506/997] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:03.874025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:03.874515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:03.874605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:03.875977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 492/998] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:03.881348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51046d-c22a-4bc8-a087-aa67a9e44934 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:03.881769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51046d-c22a-4bc8-a087-aa67a9e44934 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:03.881897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51046d-c22a-4bc8-a087-aa67a9e44934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:03.953902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5f51046d-c22a-4bc8-a087-aa67a9e44934 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:03.955067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5f51046d-c22a-4bc8-a087-aa67a9e44934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:04.016358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:04.060018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 507/999] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:04.341344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:04.342893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:04.363547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:04.447703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604975-604d-4e4a-bd1f-737c970ed010 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:04.522314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:04.523278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:04.523555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:04.523824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:04.525951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:04.597390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:04.636495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:04.637937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8fb8c-bceb-4714-9286-a6a7753c163b service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:04.656245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 493/1000] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:06.877203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:06.877728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:06.877728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:06.879095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 508/1001] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:06.884204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36acd-cee7-4111-9740-a275b9cc2a0a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:06.885114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36acd-cee7-4111-9740-a275b9cc2a0a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:06.885281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36acd-cee7-4111-9740-a275b9cc2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:06.951940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2eb36acd-cee7-4111-9740-a275b9cc2a0a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:06.953159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2eb36acd-cee7-4111-9740-a275b9cc2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:07.055578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 494/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:07.332401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:07.334042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:07.437303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa6537-d12a-4dfa-a988-83caf7fcbada None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:07.511175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:07.511831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:07.512136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:07.512465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:07.514013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:07.531827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:07.624285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:07.625626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c112b-3f6a-4a23-b22d-55e616a36b10 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:07.644215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 509/1003] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:09.846860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a9cb-7e05-436f-bff4-9b72df54d71c None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:09.847386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a9cb-7e05-436f-bff4-9b72df54d71c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:09.847490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a9cb-7e05-436f-bff4-9b72df54d71c None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:09.848781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 495/1004] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:09.854777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b972eab-9e07-4994-9d2c-f5b5cae4bd94 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:09.855203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b972eab-9e07-4994-9d2c-f5b5cae4bd94 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:09.855399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b972eab-9e07-4994-9d2c-f5b5cae4bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:09.928439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3b972eab-9e07-4994-9d2c-f5b5cae4bd94 None None] MFA Rules not processed for user `838fa254e7cd4455b3ba74c7bf9824ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:09.929669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3b972eab-9e07-4994-9d2c-f5b5cae4bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:09.997592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:10.032957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 510/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:10.333442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:10.333789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:10.334137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:10.335761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 496/1006] 10.222.0.20 () {54 vars in 964 bytes} [Sun Oct 23 00:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:10.342597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a2f54-5c37-4d0f-9cb1-aa0034c2df8d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:10.342878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a2f54-5c37-4d0f-9cb1-aa0034c2df8d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:10.343177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a2f54-5c37-4d0f-9cb1-aa0034c2df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:10.422556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-6b6a2f54-5c37-4d0f-9cb1-aa0034c2df8d None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:10.423798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6b6a2f54-5c37-4d0f-9cb1-aa0034c2df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:10.500242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 511/1007] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Oct 23 00:00:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:10.509156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:10.511335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:10.547135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:10.622971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dd9a8-e7cc-479a-96b9-8f8013ac6e2e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:10.697461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:10.697996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:10.698269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:10.698536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:10.700163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:10.776472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:10.809194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:10.810634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352704-7780-413e-8756-1db0a54f66bd service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:10.828361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 497/1008] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:13.570247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081957e4-b229-477e-8611-db8ffbc851df None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:13.570711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081957e4-b229-477e-8611-db8ffbc851df None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:13.570796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081957e4-b229-477e-8611-db8ffbc851df None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:13.572698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 512/1009] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:13.578013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac27a-a1df-4865-abe1-66daf60633d6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:13.578431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac27a-a1df-4865-abe1-66daf60633d6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:13.578555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac27a-a1df-4865-abe1-66daf60633d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:13.644069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-335ac27a-a1df-4865-abe1-66daf60633d6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:13.645274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-335ac27a-a1df-4865-abe1-66daf60633d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:13.742480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 498/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:14.020444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081957e4-b229-477e-8611-db8ffbc851df None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:14.021973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-081957e4-b229-477e-8611-db8ffbc851df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:14.090785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:14.124500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081957e4-b229-477e-8611-db8ffbc851df None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:14.198138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:14.198731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:14.199006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:14.199304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:14.200856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:14.306784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:14.308218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8aa8-cb84-4cb7-8ced-0477ed90a32c service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:14.317770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:14.327359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 513/1011] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:16.506588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:16.507203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:16.507203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:16.508503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 499/1012] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:16.513770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bed46-d9bc-42fa-9777-a441b232f066 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:16.514173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bed46-d9bc-42fa-9777-a441b232f066 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:16.514314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bed46-d9bc-42fa-9777-a441b232f066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:16.580981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-902bed46-d9bc-42fa-9777-a441b232f066 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:16.582165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-902bed46-d9bc-42fa-9777-a441b232f066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:16.675964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 514/1013] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:16.963435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:16.964995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:17.005116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:17.069229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbf85d-2967-4f75-840b-88bda6a174df None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:17.140104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:17.140702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:17.140972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:17.141237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:17.142776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:17.223996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:17.249400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:17.250813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526e4e-cb9d-4ed9-9936-fb242fd49d18 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:17.268091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 500/1014] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:19.709339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220393e-8edd-417e-b616-10a413aef82e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:19.709877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220393e-8edd-417e-b616-10a413aef82e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:19.709877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220393e-8edd-417e-b616-10a413aef82e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:19.711231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 515/1015] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:19.716864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2ecb-b76c-4a80-830f-bb3ff068783b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:19.717267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2ecb-b76c-4a80-830f-bb3ff068783b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:19.717411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c2ecb-b76c-4a80-830f-bb3ff068783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:19.783685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-399c2ecb-b76c-4a80-830f-bb3ff068783b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:19.784822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-399c2ecb-b76c-4a80-830f-bb3ff068783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:19.880817 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 501/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:20.162244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220393e-8edd-417e-b616-10a413aef82e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:20.163785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a220393e-8edd-417e-b616-10a413aef82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:20.238412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:20.265595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220393e-8edd-417e-b616-10a413aef82e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:20.338531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:20.339149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:20.339422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:20.339686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:20.341227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:20.447813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:20.449151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0e09-a617-4c0d-a261-e128013f4f10 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:20.467554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 516/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:24.533729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:24.534143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:24.534282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:24.535674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 502/1018] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:24.541548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f849-3fc7-4fa7-b6da-5d5d6e87f826 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:24.541946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f849-3fc7-4fa7-b6da-5d5d6e87f826 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:24.542090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7f849-3fc7-4fa7-b6da-5d5d6e87f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:24.547701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:24.611023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f7d7f849-3fc7-4fa7-b6da-5d5d6e87f826 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:24.612238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f7d7f849-3fc7-4fa7-b6da-5d5d6e87f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:24.707923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 517/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:24.993245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:24.995336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:25.042597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:25.098664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046104e-eba1-4d9f-a426-36b17be04a98 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:25.172602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:25.173204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:25.173477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:25.173745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:25.175355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:25.268735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:25.285198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:25.286637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772645fa-f236-4615-9032-0458b45b6e7b service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:25.304826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 503/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:00:28.092335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:28.092840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:28.092950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:28.094256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 518/1021] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:28.099518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d74-29b0-43a4-aadc-99eaa3cff45e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:28.099944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d74-29b0-43a4-aadc-99eaa3cff45e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:28.100043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc4d74-29b0-43a4-aadc-99eaa3cff45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:28.165447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fdcc4d74-29b0-43a4-aadc-99eaa3cff45e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:28.166573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fdcc4d74-29b0-43a4-aadc-99eaa3cff45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:28.278526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 504/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:28.559394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:28.560947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:28.656767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:28.673783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef6cd9-95c3-4a08-9fdf-fb8ac688e9ac None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:28.751820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:28.752343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:28.752618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:28.752888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:28.754475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:28.869999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:28.871462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcab3d9-67fd-4dfa-b56e-8b4d4002a2e2 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:28.890988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 519/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:33.388859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:33.389386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:33.389386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:33.390791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 505/1024] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:33.396828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd1c06-2040-41df-8728-603b59db1f93 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:33.397300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd1c06-2040-41df-8728-603b59db1f93 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:33.397391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd1c06-2040-41df-8728-603b59db1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:33.413757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:33.470488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a0cd1c06-2040-41df-8728-603b59db1f93 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:33.471745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a0cd1c06-2040-41df-8728-603b59db1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:33.572902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 520/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:33.889041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:33.890246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:33.970200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:34.020407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c198c-83c5-4409-9db9-1bffc7fcdc71 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:34.098806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:34.099457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:34.099736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:34.100009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:34.101612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:34.210978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:34.215225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:34.216711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f79e8-1940-4f2b-8285-5bef6c78ca14 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:34.234784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 506/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:39.212459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045d2-5ce9-4a09-a2fa-8c99c0ab22fc None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:39.213834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045d2-5ce9-4a09-a2fa-8c99c0ab22fc None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:39.213834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045d2-5ce9-4a09-a2fa-8c99c0ab22fc None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:39.214680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 521/1027] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:39.221550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ad46-e8d0-4e06-92c9-87cf57c9ab90 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:39.221978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ad46-e8d0-4e06-92c9-87cf57c9ab90 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:39.222148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ad46-e8d0-4e06-92c9-87cf57c9ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:39.350620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5238ad46-e8d0-4e06-92c9-87cf57c9ab90 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:39.351888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5238ad46-e8d0-4e06-92c9-87cf57c9ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:39.471701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 507/1028] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:00:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:00:43.504449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cf91-e414-4f86-b2ff-64b4be04dbc1 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:43.504980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cf91-e414-4f86-b2ff-64b4be04dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:43.504980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cf91-e414-4f86-b2ff-64b4be04dbc1 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:43.506523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 522/1029] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:43.511920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3854a7-3bda-4389-881a-e3107e3383a1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:43.512740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3854a7-3bda-4389-881a-e3107e3383a1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:43.513268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3854a7-3bda-4389-881a-e3107e3383a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:43.571327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=59 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:43.576981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:43.607752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2e3854a7-3bda-4389-881a-e3107e3383a1 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:43.609139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2e3854a7-3bda-4389-881a-e3107e3383a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:43.726061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 508/1030] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:00:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:45.076683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212699dd-e21b-47de-aab2-b3e25849dd2e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:45.077205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212699dd-e21b-47de-aab2-b3e25849dd2e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:45.077331 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212699dd-e21b-47de-aab2-b3e25849dd2e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:45.078814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 523/1031] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:45.083771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa29c3-ecbe-44f4-af11-7db5948ce7c9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:45.084155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa29c3-ecbe-44f4-af11-7db5948ce7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:45.084317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa29c3-ecbe-44f4-af11-7db5948ce7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:45.163379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-bdfa29c3-ecbe-44f4-af11-7db5948ce7c9 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:45.165161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bdfa29c3-ecbe-44f4-af11-7db5948ce7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:45.208222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:45.274540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 509/1032] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:00:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:48.915935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a50b-5c83-4cd4-adea-34594a275abd None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:48.916975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a50b-5c83-4cd4-adea-34594a275abd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:48.917481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a50b-5c83-4cd4-adea-34594a275abd None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:48.923828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 524/1033] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:48.925330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbe4a-6323-4f83-a741-e9ad4c6e4e0b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:48.925775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbe4a-6323-4f83-a741-e9ad4c6e4e0b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:48.925962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbe4a-6323-4f83-a741-e9ad4c6e4e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:48.998360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-77ffbe4a-6323-4f83-a741-e9ad4c6e4e0b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:48.999553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-77ffbe4a-6323-4f83-a741-e9ad4c6e4e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:49.100223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 510/1034] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:49.398089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:49.398374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:49.398652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:49.400050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 525/1035] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:49.409736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cebe4-3d15-4040-9c5f-b947789fffeb None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:49.410805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cebe4-3d15-4040-9c5f-b947789fffeb None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:49.411269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cebe4-3d15-4040-9c5f-b947789fffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:49.432362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:49.496244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b56cebe4-3d15-4040-9c5f-b947789fffeb None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:49.497426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b56cebe4-3d15-4040-9c5f-b947789fffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:49.628112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 511/1036] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:00:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:00:49.636963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:49.638470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:49.803369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aced1-77b9-40cf-9e30-63beb741821f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:49.881146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:49.927053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:49.927796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:49.928108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:49.928443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:49.930608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:50.032739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:50.034320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c140da4-3d97-418e-a380-e2d2d4c6abcd service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:50.053558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 526/1037] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:52.409811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:52.410318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:52.410412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:52.411788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 512/1038] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:52.417779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e836dc-c934-4377-84cd-06efcf35ae22 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:52.418183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e836dc-c934-4377-84cd-06efcf35ae22 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:52.418324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e836dc-c934-4377-84cd-06efcf35ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:52.487269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-86e836dc-c934-4377-84cd-06efcf35ae22 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:52.487982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-86e836dc-c934-4377-84cd-06efcf35ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:52.533233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:52.598980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 527/1039] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:52.886893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:52.888372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:52.959398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:53.059008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453a2c-e26d-4717-bc19-ea685147821b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:53.192702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:53.193313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:53.193597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:53.193865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:53.195506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:53.229502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:53.301684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:53.303332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5786f0-33d5-4981-9cce-992483c26a50 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:53.321984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 513/1040] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:55.826015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aa2a-55c1-47ad-8af2-90b821860d18 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:55.826543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aa2a-55c1-47ad-8af2-90b821860d18 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:55.826543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77aa2a-55c1-47ad-8af2-90b821860d18 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:55.827838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 528/1041] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:00:55.833157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6a4a-f1b8-4056-b683-8cf624a6387c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:55.833541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6a4a-f1b8-4056-b683-8cf624a6387c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:55.833720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d6a4a-f1b8-4056-b683-8cf624a6387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:55.903205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-804d6a4a-f1b8-4056-b683-8cf624a6387c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:55.904421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-804d6a4a-f1b8-4056-b683-8cf624a6387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:56.003502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:56.015436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 514/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:56.299963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:56.300379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:56.300724 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:56.302393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 529/1043] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:56.308091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55694e-0404-46d7-80a1-3a967b97d108 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:56.308630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55694e-0404-46d7-80a1-3a967b97d108 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:56.308969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55694e-0404-46d7-80a1-3a967b97d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:56.390077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9e55694e-0404-46d7-80a1-3a967b97d108 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:56.391301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9e55694e-0404-46d7-80a1-3a967b97d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:56.512533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 515/1044] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:00:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:56.523881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:56.525909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:56.691402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0289c1c-ac19-4f71-938a-782045efe71d None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:56.715198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:56.824100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:56.824712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:56.824989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:56.825261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:56.827167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:56.928511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:56.930294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36973e4-5d14-476d-a699-53ad20a0d806 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:56.951339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 530/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:57.083345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6d55-1602-489c-8405-62932f3d83fc None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:57.083884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6d55-1602-489c-8405-62932f3d83fc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:57.083993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6d55-1602-489c-8405-62932f3d83fc None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:57.085605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 516/1046] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:57.091670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1398-aadf-4ce3-bd94-9b14b6bd901a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:57.092079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1398-aadf-4ce3-bd94-9b14b6bd901a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:57.092248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1398-aadf-4ce3-bd94-9b14b6bd901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:57.131824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:57.174202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-308b1398-aadf-4ce3-bd94-9b14b6bd901a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:57.175543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-308b1398-aadf-4ce3-bd94-9b14b6bd901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:57.287054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 531/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:57.624388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:57.624677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:57.625018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:57.626576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 517/1048] 10.222.0.20 () {54 vars in 963 bytes} [Sun Oct 23 00:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:57.631640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79d4f-03a8-4f12-8922-5e10a1b47312 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:57.632005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79d4f-03a8-4f12-8922-5e10a1b47312 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:57.632342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b79d4f-03a8-4f12-8922-5e10a1b47312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:57.712196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f0b79d4f-03a8-4f12-8922-5e10a1b47312 None None] MFA Rules not processed for user `587f9cc7c6714a718e19a10d1d6b6385`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:57.713405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f0b79d4f-03a8-4f12-8922-5e10a1b47312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:57.763156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:57.794974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 532/1049] 10.222.0.20 () {58 vars in 1060 bytes} [Sun Oct 23 00:00:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:57.802838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:57.804365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:57.855445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:57.911043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eb072-733a-4d02-966a-e0f4fffb14cc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:57.996848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:57.997458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:57.997736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:57.997998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:57.999850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:58.112130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:58.127841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:00:58.129290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f892b-6409-4ec0-b364-d406fb0a8c92 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:00:58.150620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 518/1050] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:00:59.234824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:59.235420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:59.235420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:59.236745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 533/1051] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:00:59.241905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a895-2a28-44a0-995a-fcad971302e9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:59.242301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a895-2a28-44a0-995a-fcad971302e9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:59.242481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8a895-2a28-44a0-995a-fcad971302e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:59.309961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-09e8a895-2a28-44a0-995a-fcad971302e9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:00:59.311336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-09e8a895-2a28-44a0-995a-fcad971302e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:59.415140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 519/1052] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:00:59.707111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:00:59.708652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:00:59.862534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2cd6-3517-42e7-8d71-e3c2b7ffea4e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:00:59.921559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:00:59.986264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:00:59.986873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:00:59.987280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:00:59.987966 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:00:59.989024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:00.082922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:00.084662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054e42d-2b24-440e-87f8-e0a5bd978b0b service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:00.105476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 534/1053] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:02.331930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:02.332483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:02.332483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:02.333985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 520/1054] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:02.339115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ebaf-76ea-4b36-a4f0-16800182a652 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:02.339547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ebaf-76ea-4b36-a4f0-16800182a652 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:02.339866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360ebaf-76ea-4b36-a4f0-16800182a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:02.415020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b360ebaf-76ea-4b36-a4f0-16800182a652 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:02.416464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b360ebaf-76ea-4b36-a4f0-16800182a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:02.423734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:02.531837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 535/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:02.807708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:02.809340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:02.874678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:02.963789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f841-3372-4f5e-8a22-e15fa0a546e3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:03.082928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:03.083713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:03.084086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:03.084456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:03.086799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:03.106763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:03.183593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:03.185331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b7739-1f3b-40ca-9e66-deaed458376b service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:03.204659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 521/1056] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:05.413478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:05.414484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:05.414591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:05.419669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 536/1057] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:05.421249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f442c5-8b4a-4ccc-bffd-3bce269e703c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:05.421650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f442c5-8b4a-4ccc-bffd-3bce269e703c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:05.421798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f442c5-8b4a-4ccc-bffd-3bce269e703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:05.494467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-14f442c5-8b4a-4ccc-bffd-3bce269e703c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:05.495893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-14f442c5-8b4a-4ccc-bffd-3bce269e703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:05.610154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:05.617196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 522/1058] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:05.904072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:05.905769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:06.052397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:06.068641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eaea0-8b02-446a-9a3d-8c7681949861 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:06.190415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:06.190948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:06.191258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:06.191533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:06.193107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:06.305036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:06.306629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21bb64-0ad8-4fd4-abed-d1d806a2952e service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:06.317350 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:06.328367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 537/1059] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:08.599543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:08.600194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:08.600194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:08.601599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 523/1060] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:08.606654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2187-4323-41b4-851b-29142bd60b58 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:08.607150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2187-4323-41b4-851b-29142bd60b58 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:08.607319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2187-4323-41b4-851b-29142bd60b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:08.674253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-422f2187-4323-41b4-851b-29142bd60b58 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:08.675520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-422f2187-4323-41b4-851b-29142bd60b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:08.781010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 538/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:09.113210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:09.115281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:09.285181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89640e-66e6-4334-91e0-8ce8b3d7537c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:09.362113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:09.410979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:09.411623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:09.411903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:09.412175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:09.413840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:09.505636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:09.507278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af6332-c789-44fa-80cc-0c106fbae47a service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:09.526594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 524/1062] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:12.023880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:12.024573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:12.024573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:12.025780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 539/1063] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:12.031464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45272525-634b-44a1-b593-0a3af424880d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:12.031903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45272525-634b-44a1-b593-0a3af424880d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:12.032012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45272525-634b-44a1-b593-0a3af424880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:12.101994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-45272525-634b-44a1-b593-0a3af424880d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:12.103371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-45272525-634b-44a1-b593-0a3af424880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:12.139547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:12.203643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 525/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:12.489688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:12.491268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:12.570757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:12.641110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7543d-36f3-40ee-bae3-525f96c6406e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:12.751548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:12.752075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:12.752352 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:12.752621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:12.754180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:12.792586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:12.844522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:12.846105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c0468-41a3-448b-a913-ac5113b44c5a service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:12.863986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 540/1065] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:13.352877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c576-3959-4301-9745-de2cf706ffad None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:13.353445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c576-3959-4301-9745-de2cf706ffad None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:13.353445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c576-3959-4301-9745-de2cf706ffad None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:13.354830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 526/1066] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:13.360246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396327b-84ae-4903-a5bb-97502dc26cc0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:13.360715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396327b-84ae-4903-a5bb-97502dc26cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:13.360915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396327b-84ae-4903-a5bb-97502dc26cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:13.425957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1396327b-84ae-4903-a5bb-97502dc26cc0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:13.427456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1396327b-84ae-4903-a5bb-97502dc26cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:13.528904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 541/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:13.828666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856b89-c154-4a23-ab46-3143446c598b None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:13.829023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856b89-c154-4a23-ab46-3143446c598b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:13.829363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856b89-c154-4a23-ab46-3143446c598b None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:13.830784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 527/1068] 10.222.0.20 () {54 vars in 962 bytes} [Sun Oct 23 00:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:13.836805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773b5b-253f-4324-9746-f6153964786c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:13.837093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773b5b-253f-4324-9746-f6153964786c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:13.837364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773b5b-253f-4324-9746-f6153964786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:13.852827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:13.914285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-72773b5b-253f-4324-9746-f6153964786c None None] MFA Rules not processed for user `eeb59ec19c77483b9f6bea59189b22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:13.915524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-72773b5b-253f-4324-9746-f6153964786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:13.992197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 542/1069] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Oct 23 00:01:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:13.999991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856b89-c154-4a23-ab46-3143446c598b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:14.001479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-64856b89-c154-4a23-ab46-3143446c598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:14.105511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856b89-c154-4a23-ab46-3143446c598b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:14.164759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:14.181489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:14.182099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:14.182375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:14.182645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:14.184256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:14.294943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:14.296404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a8098-f442-4ba2-bf92-f3b4aac6fcad service glance] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:14.314898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 528/1070] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:15.053606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff241dc-097b-4a70-bfa4-bd151342f2d6 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.054154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff241dc-097b-4a70-bfa4-bd151342f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.054154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff241dc-097b-4a70-bfa4-bd151342f2d6 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.055856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 543/1071] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:15.061195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644684-8e45-4d92-b00c-312e2467ea67 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.061615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644684-8e45-4d92-b00c-312e2467ea67 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.061791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644684-8e45-4d92-b00c-312e2467ea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.067866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded643-dd47-48ab-90d7-bb810b4e110e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.067866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded643-dd47-48ab-90d7-bb810b4e110e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.068115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded643-dd47-48ab-90d7-bb810b4e110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.138872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d0ded643-dd47-48ab-90d7-bb810b4e110e None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:15.140752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d0ded643-dd47-48ab-90d7-bb810b4e110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.144918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1d644684-8e45-4d92-b00c-312e2467ea67 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:15.146119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1d644684-8e45-4d92-b00c-312e2467ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.192126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:15.209043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:15.241451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 544/1072] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:01:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:15.253913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 529/1073] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:15.283777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.284064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.284339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.285691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 545/1074] 10.222.0.20 () {54 vars in 943 bytes} [Sun Oct 23 00:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:15.292250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563eda-3190-4b96-812b-654168c41acf None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.292535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563eda-3190-4b96-812b-654168c41acf None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.292836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08563eda-3190-4b96-812b-654168c41acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.368748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-08563eda-3190-4b96-812b-654168c41acf None None] MFA Rules not processed for user `318a76b9d85747f5ae83df6d6b497131`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:15.369947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-08563eda-3190-4b96-812b-654168c41acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.475133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 530/1075] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Oct 23 00:01:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:15.484293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:15.485800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.543622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08563eda-3190-4b96-812b-654168c41acf None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:15.544813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-08563eda-3190-4b96-812b-654168c41acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.547864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:15.628978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454db86-31b8-42ae-b0ca-ab005243a401 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:15.648971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08563eda-3190-4b96-812b-654168c41acf None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:15.690683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:15.735716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:15.736322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.736601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.736864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.738465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.766308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:15.766983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:15.767286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:15.767562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:15.769132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:15.781954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:15.821658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:15.823253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8644-2526-4838-b27e-5393b9f6b857 service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:15.831255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 546/1076] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:01:15.863554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:15.865237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3dbb3-aee0-4100-89ad-2b3718d26bc1 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:15.884582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 531/1077] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:01:18.134822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:18.135400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:18.135400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:18.136896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 547/1078] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:18.142390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3942eb-b2a5-4073-9cd7-3e4248d328f3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:18.142791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3942eb-b2a5-4073-9cd7-3e4248d328f3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:18.142882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3942eb-b2a5-4073-9cd7-3e4248d328f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:18.221912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fa3942eb-b2a5-4073-9cd7-3e4248d328f3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:18.223535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fa3942eb-b2a5-4073-9cd7-3e4248d328f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:18.320279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:18.333266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 532/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:18.628365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:18.629951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:18.728745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:18.787099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f9cb-8c69-4244-b9a7-7b85686dd080 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:18.914307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:18.914927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:18.915242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:18.915517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:18.917128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:18.978668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:19.015335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:19.017493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22f51-a7d6-47d3-8923-d3b5fe30dd4f service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:19.041153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 548/1080] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:21.294777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:21.295388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:21.295388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:21.296883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 533/1081] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:21.302595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53ef-8627-4987-bff6-bd89d9affcc1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:21.303113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53ef-8627-4987-bff6-bd89d9affcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:21.303224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53ef-8627-4987-bff6-bd89d9affcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:21.375770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-014a53ef-8627-4987-bff6-bd89d9affcc1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:21.376999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-014a53ef-8627-4987-bff6-bd89d9affcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:21.487213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 549/1082] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:01:21.774936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:21.776495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:21.956045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51ae9-a012-4a48-b97c-4a9adac7f22f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:22.031531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:22.091452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:22.092069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:22.092346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:22.092620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:22.094209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:22.202133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:22.203824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda94074-ba81-4896-9379-407402b759a9 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:22.229403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 534/1083] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:24.429364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:24.429893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:24.429893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:24.431262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 550/1084] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:24.436470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568f70-7d52-405c-a31e-1c2944f64949 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:24.436946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568f70-7d52-405c-a31e-1c2944f64949 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:24.437038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568f70-7d52-405c-a31e-1c2944f64949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:24.504576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-67568f70-7d52-405c-a31e-1c2944f64949 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:24.505784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-67568f70-7d52-405c-a31e-1c2944f64949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:24.541623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:24.618703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 535/1085] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:24.906663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:24.908218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:24.949254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:25.072071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be44de-e3de-4839-bb70-c6018e3ff44a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:25.190330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:25.197673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:25.198475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:25.198708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:25.199010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:25.201137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:25.301838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:25.303566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60c58-48e4-4467-8d9c-21f9e7491624 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:25.323558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 551/1086] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:34.615810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=31 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:35.320953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=47 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:38.442812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae89a-e1de-43f6-984a-f871dfacc43e None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:38.443389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae89a-e1de-43f6-984a-f871dfacc43e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:38.443389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ae89a-e1de-43f6-984a-f871dfacc43e None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:38.445234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 536/1087] 10.222.0.20 () {54 vars in 918 bytes} [Sun Oct 23 00:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:38.450309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-0159-48f7-b79f-528e08400c06 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:38.450758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-0159-48f7-b79f-528e08400c06 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:38.450867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-0159-48f7-b79f-528e08400c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:38.527350 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-95c21cd8-0159-48f7-b79f-528e08400c06 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:38.528587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-95c21cd8-0159-48f7-b79f-528e08400c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:38.632622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 552/1088] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Oct 23 00:01:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:38.646677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a47-3633-4a2b-be6a-7b898b9a3e3a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:38.647547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a47-3633-4a2b-be6a-7b898b9a3e3a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:38.647823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a47-3633-4a2b-be6a-7b898b9a3e3a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:38.649135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 537/1089] 10.222.0.20 () {54 vars in 918 bytes} [Sun Oct 23 00:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:38.653620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f663c6-e616-4202-9ca1-e0081b8c79ce None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:38.653896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f663c6-e616-4202-9ca1-e0081b8c79ce None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:38.654166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f663c6-e616-4202-9ca1-e0081b8c79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:38.725893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:38.728696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-38f663c6-e616-4202-9ca1-e0081b8c79ce None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:38.730394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-38f663c6-e616-4202-9ca1-e0081b8c79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:38.842130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 553/1090] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Oct 23 00:01:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:41.377459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:41.378041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:41.378041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:41.379373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 538/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:41.385027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a553-3b82-4154-a7a5-fac812412534 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:41.385421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a553-3b82-4154-a7a5-fac812412534 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:41.385579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a553-3b82-4154-a7a5-fac812412534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:41.451447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2598a553-3b82-4154-a7a5-fac812412534 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:41.452646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2598a553-3b82-4154-a7a5-fac812412534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:41.504959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:41.547427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 554/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:41.833980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:41.836098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:41.982097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bed3e1-5f67-4f44-b885-d01943f1b7a9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:42.053638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:42.093567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:42.094169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:42.094440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:42.094703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:42.096288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:42.183287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:42.184869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae1ad-2fd6-4a19-b927-7cfdb57d9e39 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:42.202765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 539/1093] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:43.325968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:43.326539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:43.326539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:43.327923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 555/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:43.332953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7865af-452b-4d46-b6aa-5787f80846d5 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:43.333348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7865af-452b-4d46-b6aa-5787f80846d5 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:43.333495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7865af-452b-4d46-b6aa-5787f80846d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:43.408109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5f7865af-452b-4d46-b6aa-5787f80846d5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:43.409310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5f7865af-452b-4d46-b6aa-5787f80846d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:43.436150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:43.504356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 540/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:43.652650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:43.654183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:43.795685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19db16-ac4b-440e-9504-e68e7b3d3a56 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:43.834937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:43.906137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:43.906669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:43.906944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:43.907244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:43.909246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:43.997123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:43.998706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c007550-3fb9-46b5-85a3-ac8587f3bb90 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:44.016677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 556/1096] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:45.121588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:45.122128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:45.122128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:45.123568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 541/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:01:45.128454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b22e9-2c53-4d29-b684-e4ad9e9b4a77 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:45.128931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b22e9-2c53-4d29-b684-e4ad9e9b4a77 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:45.129026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b22e9-2c53-4d29-b684-e4ad9e9b4a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:45.183994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:45.206827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5a5b22e9-2c53-4d29-b684-e4ad9e9b4a77 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:45.208075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5a5b22e9-2c53-4d29-b684-e4ad9e9b4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:45.303723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 557/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:45.453411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:45.454827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:45.598393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3cd5b-19b0-4b0d-8e1d-e8ba5ab8b06a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:45.610854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:45.710496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:45.711017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:45.711321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:45.711590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:45.713152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:45.800588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:45.802412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e7034-d955-44ca-b6fc-891a03fc9f88 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:45.820237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 542/1099] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:46.911442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:46.912049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:46.912049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:46.913362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 558/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:46.918187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ad8d-8d3c-4f3a-a885-c26aaa4854ac None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:46.918605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ad8d-8d3c-4f3a-a885-c26aaa4854ac None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:46.918719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ad8d-8d3c-4f3a-a885-c26aaa4854ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:46.938782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:46.994391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-60d1ad8d-8d3c-4f3a-a885-c26aaa4854ac None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:46.995620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-60d1ad8d-8d3c-4f3a-a885-c26aaa4854ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:47.090130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 543/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:47.239688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:47.241725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:47.351706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:47.387242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533284-b088-4b9f-aabd-2f74d54f46f9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:47.495913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:47.496509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:47.496780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:47.497043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:47.498589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:47.573798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:47.587888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:47.589526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7c42f-4dad-46c2-b84b-e79e820aa6eb service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:47.607773 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 559/1102] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:48.706706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:48.707250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:48.707250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:48.708572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 544/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:48.713621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c4b0-003d-4d76-b3f4-af31d9331426 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:48.714022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c4b0-003d-4d76-b3f4-af31d9331426 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:48.714169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c4b0-003d-4d76-b3f4-af31d9331426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:48.789643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1df2c4b0-003d-4d76-b3f4-af31d9331426 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:48.790855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1df2c4b0-003d-4d76-b3f4-af31d9331426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:48.887420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 560/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:49.034390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:49.035879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:49.121019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:49.182810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f35ff-0637-40b1-8210-e68f0a3546d8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:49.297716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:49.298267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:49.298539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:49.298804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:49.300399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:49.347934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:49.388387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:49.389969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2960bb-7040-4296-8c6a-0ac6c87c232f service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:49.407815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 545/1105] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:50.451398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:50.451969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:50.451969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:50.453321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 561/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:50.458463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4983bea-105b-4ebd-96c6-0c9e085c3d0c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:50.458898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4983bea-105b-4ebd-96c6-0c9e085c3d0c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:50.459003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4983bea-105b-4ebd-96c6-0c9e085c3d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:50.534859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a4983bea-105b-4ebd-96c6-0c9e085c3d0c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:50.536098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a4983bea-105b-4ebd-96c6-0c9e085c3d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:50.634476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 546/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:50.786029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:50.787515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:50.836100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:50.931609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa34b-7fa0-49e7-a42a-2db0c8bb4617 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:51.041514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:51.042047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:51.042326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:51.042599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:51.044201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:51.050965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:51.133448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:51.135021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922551e-15a6-4ff6-890c-307f2815cecc service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:51.152365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 562/1108] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:52.190714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:52.191270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:52.191270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:52.192837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 547/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:52.197604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a746007-fb7c-4081-b244-a2b9589216f9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:52.198032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a746007-fb7c-4081-b244-a2b9589216f9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:52.198146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a746007-fb7c-4081-b244-a2b9589216f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:52.274446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0a746007-fb7c-4081-b244-a2b9589216f9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:52.275668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0a746007-fb7c-4081-b244-a2b9589216f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:52.343296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:52.372241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 563/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:52.521232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:52.523269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:52.540966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:52.667226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae34a6-9e9a-4bd5-ab84-672507df9dc4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:52.753609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:52.780083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:52.780626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:52.780900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:52.781167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:52.782727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:52.870464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:52.872069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0810-b41e-4626-b41e-d878a2037230 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:52.890022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 548/1111] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:53.930391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:53.930843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:53.930958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:53.932355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 564/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:53.937630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973ee0-bbad-43c2-bcf1-344a1c9fdb47 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:53.938046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973ee0-bbad-43c2-bcf1-344a1c9fdb47 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:53.938173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973ee0-bbad-43c2-bcf1-344a1c9fdb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:54.013105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1b973ee0-bbad-43c2-bcf1-344a1c9fdb47 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:54.014313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1b973ee0-bbad-43c2-bcf1-344a1c9fdb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:54.057392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:54.111976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 549/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:54.260537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:54.261984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:54.405571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c579af8-97e9-4af1-a19e-429a1bf3f372 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:54.458430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:54.516351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:54.516887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:54.517164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:54.517434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:54.519012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:54.608204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:54.609783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538f786-d502-4103-b1a2-e10292694db2 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:54.627779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 565/1114] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:55.657541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:55.658088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:55.658088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:55.659482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 550/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:55.664467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178234-58fa-4b2f-808e-2e894b9eb798 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:55.664844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178234-58fa-4b2f-808e-2e894b9eb798 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:55.665014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178234-58fa-4b2f-808e-2e894b9eb798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:55.739782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-df178234-58fa-4b2f-808e-2e894b9eb798 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:55.740994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-df178234-58fa-4b2f-808e-2e894b9eb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:55.743091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:55.835865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 566/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:55.984888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:55.986446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:56.129144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593c8c2-01ae-4073-9290-0c3cc89e3555 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:56.156275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:56.242336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:56.243053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:56.243246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:56.243513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:56.245086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:56.333744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:56.335909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447155a-b61f-4330-a8d5-eb1cc85ad048 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:56.353549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 551/1117] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:01:58.383648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:58.384245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:58.384245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:58.385530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 567/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:01:58.390841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9ab7-1008-4800-8117-f5500304c05b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:58.391321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9ab7-1008-4800-8117-f5500304c05b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:58.391422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f9ab7-1008-4800-8117-f5500304c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:58.431929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:58.458148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-726f9ab7-1008-4800-8117-f5500304c05b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:01:58.459390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-726f9ab7-1008-4800-8117-f5500304c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:58.558773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 552/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:01:58.840677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:01:58.842208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:58.944062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd296-57b1-4a4a-904b-790ef317a4ff None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:01:58.976679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:01:59.016915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:01:59.017511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:01:59.017784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:01:59.018052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:01:59.019639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:01:59.126240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:01:59.127613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ad194-5ac5-4d6f-b952-f48c26e72a6e service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:01:59.144822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 568/1120] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:01.422585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:01.423184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:01.423184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:01.424513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 553/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:01.430549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa464-c6d0-48c0-a952-ce80b9fc574c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:01.430941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa464-c6d0-48c0-a952-ce80b9fc574c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:01.431111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa464-c6d0-48c0-a952-ce80b9fc574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:01.495304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-697aa464-c6d0-48c0-a952-ce80b9fc574c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:01.496495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-697aa464-c6d0-48c0-a952-ce80b9fc574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:01.508878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:01.592597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 569/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:01.875675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:01.877215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:01.978713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1578e-0001-4816-9c47-f38dc36dd2b7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:01.990907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:02.050681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:02.051569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:02.051844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:02.052115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:02.054209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:02.162887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:02.164257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce913c-3145-454a-9354-cc159b1868de service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:02.182706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 554/1123] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:04.624408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:04.624998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:04.624998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:04.626313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 570/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:04.631720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8307-444b-4ab3-a83e-209ad4989d28 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:04.632142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8307-444b-4ab3-a83e-209ad4989d28 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:04.632268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8307-444b-4ab3-a83e-209ad4989d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:04.680595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:04.698167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-070a8307-444b-4ab3-a83e-209ad4989d28 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:04.699398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-070a8307-444b-4ab3-a83e-209ad4989d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:04.793763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 555/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:05.080001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:05.081535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:05.183129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae05595-3d7e-4573-b27b-76b56fad089b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:05.224747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:05.259510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:05.260119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:05.260398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:05.260672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:05.262250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:05.372063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:05.373479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7b59e-8bdb-4632-b18a-dd50b40ccbf4 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:05.391004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 571/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:07.649419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:07.649983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:07.649983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:07.651358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 556/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:07.656749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82dff-07c5-499a-af4c-4df2b999751b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:07.657165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82dff-07c5-499a-af4c-4df2b999751b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:07.657280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82dff-07c5-499a-af4c-4df2b999751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:07.721647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8ba82dff-07c5-499a-af4c-4df2b999751b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:07.722827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8ba82dff-07c5-499a-af4c-4df2b999751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:07.744376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:07.820280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 572/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:08.107766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:08.109291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:08.213358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0127c-9205-422f-9599-19414bdbd071 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:08.233626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:08.286076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:08.287212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:08.287490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:08.287753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:08.289310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:08.395794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:08.397196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb1961-644a-4a4e-8a81-977c5acfab44 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:08.415259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 557/1129] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:10.633362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:10.633932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:10.633932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:10.635297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 573/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:10.640529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049cb7-93cf-4dd0-9593-ede4cd90c07f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:10.640964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049cb7-93cf-4dd0-9593-ede4cd90c07f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:10.641071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049cb7-93cf-4dd0-9593-ede4cd90c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:10.707354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:10.710110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9b049cb7-93cf-4dd0-9593-ede4cd90c07f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:10.711861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9b049cb7-93cf-4dd0-9593-ede4cd90c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:10.808475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 558/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:11.089587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:11.091183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:11.192815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32737c1-b6ba-4533-abc2-63456371ddbd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:11.241980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:11.265993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:11.266600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:11.266881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:11.267187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:11.268756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:11.375321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:11.376656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96335f-13b9-4bb2-8625-1f35970939be service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:11.394420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 574/1132] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:13.581844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:13.582349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:13.582451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:13.583896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 559/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:13.589341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880150e4-c96b-457e-9fc2-dd2d92f0a1df None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:13.589768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880150e4-c96b-457e-9fc2-dd2d92f0a1df None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:13.589881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880150e4-c96b-457e-9fc2-dd2d92f0a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:13.656482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-880150e4-c96b-457e-9fc2-dd2d92f0a1df None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:13.657673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-880150e4-c96b-457e-9fc2-dd2d92f0a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:13.686804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:13.752744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 575/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:14.034969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:14.037104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:14.138326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001bddb-4e2e-4c0d-971b-86eaf602c390 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:14.168059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:14.213843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:14.214354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:14.214628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:14.214899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:14.216506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:14.323917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:14.325389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2247-bd66-4723-9221-d6b6f2d1515c service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:14.343319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 560/1135] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:16.550783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:16.551499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:16.551632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:16.553102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 576/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:16.558614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf1cc-5ffc-4d5b-8c2d-50d873476030 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:16.559009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf1cc-5ffc-4d5b-8c2d-50d873476030 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:16.559185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf1cc-5ffc-4d5b-8c2d-50d873476030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:16.625264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8c9cf1cc-5ffc-4d5b-8c2d-50d873476030 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:16.626488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8c9cf1cc-5ffc-4d5b-8c2d-50d873476030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:16.634681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:16.720831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 561/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:17.011545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:17.013089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:17.114233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89f90c-7358-4e4a-8766-bc93dff24b0a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:17.168336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:17.186635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:17.187261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:17.187541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:17.187807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:17.189361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:17.297954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:17.299396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6ce2-aa61-456b-b775-265fb41afa62 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:17.317532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 577/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:19.488536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:19.489071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:19.489071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:19.490929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 562/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:19.496283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fe8e-e49f-4d0c-8edc-41df57e29fa4 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:19.496665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fe8e-e49f-4d0c-8edc-41df57e29fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:19.496833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579fe8e-e49f-4d0c-8edc-41df57e29fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:19.564603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a579fe8e-e49f-4d0c-8edc-41df57e29fa4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:19.565792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a579fe8e-e49f-4d0c-8edc-41df57e29fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:19.603602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:19.660745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 578/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:19.941477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:19.943668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:20.044619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a25fba-4e34-4556-b1d0-53fa7bc60f29 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:20.082418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:20.118923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:20.119546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:20.119821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:20.120088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:20.121645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:20.228915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:20.230280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28998d-efb0-4799-8138-5505a8055b41 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:20.248826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 563/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:22.437274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:22.437851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:22.437851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:22.439189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 579/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:22.444671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be4fc3-0dfd-4f6b-9be2-205b77eb92ed None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:22.445080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be4fc3-0dfd-4f6b-9be2-205b77eb92ed None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:22.445226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be4fc3-0dfd-4f6b-9be2-205b77eb92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:22.510138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b0be4fc3-0dfd-4f6b-9be2-205b77eb92ed None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:22.511282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b0be4fc3-0dfd-4f6b-9be2-205b77eb92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:22.530230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:22.612433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 564/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:22.899042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:22.900592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:23.000969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42026e8-f8c4-455b-a8c6-8a31ec2bccdd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:23.066421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:23.073973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:23.074573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:23.074847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:23.075145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:23.076715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:23.181996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:23.183356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2309-981c-4d05-8b8b-0e147d921cf2 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:23.201697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 580/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:25.372911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:25.373487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:25.373487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:25.374795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 565/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:25.380883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9afe4-af86-4361-88db-ddbf59592f9f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:25.381284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9afe4-af86-4361-88db-ddbf59592f9f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:25.381423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9afe4-af86-4361-88db-ddbf59592f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:25.447097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3fc9afe4-af86-4361-88db-ddbf59592f9f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:25.448302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3fc9afe4-af86-4361-88db-ddbf59592f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:25.496398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:25.546147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 581/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:25.833530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:25.835127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:25.937931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93c5a-9c1f-435a-bd65-9c92f7f74716 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:25.985391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:26.010258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:26.010860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:26.011160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:26.011436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:26.013001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:26.120461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:26.121810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9ceea-ff52-4c1e-8996-a182574a0d86 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:26.139633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 566/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:35.544643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=22 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:36.137405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=66 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:46.030187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f17-289a-4e3e-952d-eda964953418 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:46.030737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f17-289a-4e3e-952d-eda964953418 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:46.030848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630f17-289a-4e3e-952d-eda964953418 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:46.032156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 582/1148] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:46.037647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360e963-256d-4691-9a9f-b434f2ad53ae None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:46.038036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360e963-256d-4691-9a9f-b434f2ad53ae None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:46.038180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360e963-256d-4691-9a9f-b434f2ad53ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:46.103087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3360e963-256d-4691-9a9f-b434f2ad53ae None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:46.104284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3360e963-256d-4691-9a9f-b434f2ad53ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:46.200916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 567/1149] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:46.498935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:46.499252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:46.499535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:46.500862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 583/1150] 10.222.0.20 () {54 vars in 962 bytes} [Sun Oct 23 00:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:46.506372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c846-98cd-4e3b-a989-adf86566ac02 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:46.506655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c846-98cd-4e3b-a989-adf86566ac02 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:46.506927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c846-98cd-4e3b-a989-adf86566ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:46.581925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-db92c846-98cd-4e3b-a989-adf86566ac02 None None] MFA Rules not processed for user `eeb59ec19c77483b9f6bea59189b22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:46.583134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-db92c846-98cd-4e3b-a989-adf86566ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:46.603472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:46.658180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 568/1151] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Oct 23 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:46.666382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:46.667928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:46.769235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1022297-ed5b-42b8-bc7c-45de7b951581 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:46.843829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:46.844431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:46.844708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:46.844984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:46.846552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:46.900263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:46.953774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:46.955230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06523c7-7e2a-4e06-919b-0d941db96e8d service glance] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:46.974174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 584/1152] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:49.217661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:49.218220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:49.218220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:49.219609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 569/1153] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:49.225386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa38d6-8a06-45bb-9192-db094a496ec1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:49.225831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa38d6-8a06-45bb-9192-db094a496ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:49.225935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa38d6-8a06-45bb-9192-db094a496ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:49.291682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-6daa38d6-8a06-45bb-9192-db094a496ec1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:49.292921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6daa38d6-8a06-45bb-9192-db094a496ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:49.389545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 585/1154] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:49.663084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:49.664631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:49.788385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8ee9f-7163-41e6-9de9-f5aee8ad7c7a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:49.836848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:49.880357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:49.880960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:49.881234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:49.881505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:49.882131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:49.883161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:02:49.883161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:02:49.883161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:02:49.884297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5341fe-ff3e-41e6-adfb-88be1cec0923 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:49.903370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 570/1155] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Oct 23 00:02:49 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:02:52.066405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:52.066955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:52.066955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:52.068329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 586/1156] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:52.073987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ac1d-2452-41dc-bb71-29bc6be93bb4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:52.074403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ac1d-2452-41dc-bb71-29bc6be93bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:52.074538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ac1d-2452-41dc-bb71-29bc6be93bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:52.140498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3a95ac1d-2452-41dc-bb71-29bc6be93bb4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:52.141705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3a95ac1d-2452-41dc-bb71-29bc6be93bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:52.238904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 571/1157] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:02:52.534765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:52.536986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:52.546771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:52.680550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b455d4-a9c0-47b8-88af-e970f9c34414 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:52.760001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:52.793071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:52.793631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:52.793909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:52.794181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:52.795782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:52.883604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:52.885169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212bda1-adaf-4ee3-8ca8-cc76961354d0 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:52.902968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 587/1158] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:55.234232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:55.234802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:55.234802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:55.236182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 572/1159] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:55.241590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430e6c-a648-4c26-ab95-5d04345d27ff None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:55.242015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430e6c-a648-4c26-ab95-5d04345d27ff None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:55.242129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430e6c-a648-4c26-ab95-5d04345d27ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:55.307636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-30430e6c-a648-4c26-ab95-5d04345d27ff None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:55.308850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-30430e6c-a648-4c26-ab95-5d04345d27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:55.355963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:55.405809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 588/1160] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:02:55.693689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:55.695261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:55.719133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:55.797574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd727904-8e65-4414-89ae-89211203fd58 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:55.871142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:55.871775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:55.872054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:55.872327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:55.873904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:55.947664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:55.982193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:55.983691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76871-3d95-4fa8-99cb-4e9bb9b03d35 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:56.002274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 573/1161] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:02:58.179554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:58.180102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:58.180102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:58.181457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 589/1162] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:02:58.186598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf761b-288b-4a83-9101-9f62d245b3e1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:58.187021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf761b-288b-4a83-9101-9f62d245b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:58.187175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf761b-288b-4a83-9101-9f62d245b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:58.251676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-cbbf761b-288b-4a83-9101-9f62d245b3e1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:02:58.252782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-cbbf761b-288b-4a83-9101-9f62d245b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:58.346475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 574/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:02:58.636459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:02:58.637976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:58.738267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5f6a-d08f-484f-a6a9-281bb12ece10 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:02:58.808477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:02:58.809853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:02:58.810500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:02:58.810983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:02:58.811459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:02:58.813231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:02:58.919578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:02:58.920995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a857c69-c4a7-4c17-8658-d9a588fa4ecb service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:02:58.938915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 590/1164] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:03:01.227804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:01.228409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:01.228409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:01.229728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 575/1165] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:03:01.234896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386ee3-21a5-40e0-87b7-c55a16f69b94 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:01.235344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386ee3-21a5-40e0-87b7-c55a16f69b94 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:01.235478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386ee3-21a5-40e0-87b7-c55a16f69b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:01.300017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b1386ee3-21a5-40e0-87b7-c55a16f69b94 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:03:01.301996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b1386ee3-21a5-40e0-87b7-c55a16f69b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:01.353933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:01.398658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 591/1166] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:03:01.688697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:03:01.690215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:01.726307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:01.792998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1bf89-4dc3-43b3-8870-055f0a2799b7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:03:01.866194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:03:01.866793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:01.867088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:01.867364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:01.868929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:01.948788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:01.977879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:03:01.979341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb31fc-d166-4431-a351-c469e71407ad service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:03:01.997369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 576/1167] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:03:04.387435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19b10-1620-4e38-9982-9863d198937f None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:04.387964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19b10-1620-4e38-9982-9863d198937f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:04.387964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19b10-1620-4e38-9982-9863d198937f None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:04.389305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 592/1168] 10.222.0.20 () {54 vars in 927 bytes} [Sun Oct 23 00:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:03:04.395312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b7d6-27f4-4cc2-b465-ad7abc3a6e39 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:04.395727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b7d6-27f4-4cc2-b465-ad7abc3a6e39 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:04.395933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b7d6-27f4-4cc2-b465-ad7abc3a6e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:04.461948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4dd4b7d6-27f4-4cc2-b465-ad7abc3a6e39 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:03:04.463163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4dd4b7d6-27f4-4cc2-b465-ad7abc3a6e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:04.560773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 577/1169] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Oct 23 00:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:03:04.846388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19b10-1620-4e38-9982-9863d198937f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:03:04.848479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-edd19b10-1620-4e38-9982-9863d198937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:04.949319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19b10-1620-4e38-9982-9863d198937f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:03:05.022444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:03:05.023043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:03:05.023346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:03:05.023615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:03:05.025193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:03:05.034356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:05.132056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:03:05.133440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984c474-85c2-4007-bfb3-cab2010e657e service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:03:05.151163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 593/1170] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:03:14.559257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=82 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:03:15.148971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=50 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:24.238186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:24.238791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:24.238791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:24.314850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:04:24.316012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:24.410879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 578/1171] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:04:24.418753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303167-a52c-4671-820b-d4b5124798fd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:24.419279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303167-a52c-4671-820b-d4b5124798fd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:24.419389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303167-a52c-4671-820b-d4b5124798fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:24.494092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-77303167-a52c-4671-820b-d4b5124798fd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:04:24.495391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-77303167-a52c-4671-820b-d4b5124798fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:24.590200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 594/1172] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:04:24.594818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:24.596068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:24.607382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa82f0-6440-4b73-a0eb-a81069c3dade None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:24.669083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:24.703099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:24.703710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:24.703986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:24.704257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:24.704915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:04:24.705221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:24.706221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:04:24.706221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:04:24.706221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:04:24.707126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:24.718087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 579/1173] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:04:24.727961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77303167-a52c-4671-820b-d4b5124798fd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:24.737416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77303167-a52c-4671-820b-d4b5124798fd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:24.797713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:24.831222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:24.831817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:24.832089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:24.832354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:24.832963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:24.834038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:04:24.834038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 23 00:04:24.834038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 23 00:04:24.835250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:24.890163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 595/1174] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:04:24 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:04:24.894299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:24.895881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:24.930190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abef84-039e-4c51-a7c6-7ad185c31b5d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:25.022771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:25.023416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.023696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.023973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.024600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:25.025637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:04:25.025637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:04:25.025637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:04:25.026855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:25.068741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 580/1175] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:04:24 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:04:25.072888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:25.074420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.135230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee3eb-8d31-4175-bf6a-b8c73c5ca067 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:25.217848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:25.228931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:25.229535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.229809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.230077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.230705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:25.232301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:25.244804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 596/1176] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:04:25.248757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:25.250276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.261657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299fe88-9312-4004-a163-a68ae72c5d1e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:25.287206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:25.358466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:25.359092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.359378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.359648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.360282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:25.361858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72bbf2-e5f8-4ed2-a5ef-53ca83024984 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:25.374285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 581/1177] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:04:25.378374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:25.379960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.413749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6404-58f7-4043-ad09-8057fc49630e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:25.505339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:25.505971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.506183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.506454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] PATH_INFO: `/v3/projects/ab994cc8c691499384da972843ab1439/users/f54adb8f91504bd1bc9e2c785bfba6b6/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.531590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab994cc8c691499384da972843ab1439, user_id=f54adb8f91504bd1bc9e2c785bfba6b6, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:25.534861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0e72e-0c8c-4f79-8d41-7a5ed35aa705 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:25.560578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 597/1178] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:04:25 2022] PUT /identity/v3/projects/ab994cc8c691499384da972843ab1439/users/f54adb8f91504bd1bc9e2c785bfba6b6/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:04:25.571685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae55c-a276-4983-8f8a-2f2b17823831 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.571970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae55c-a276-4983-8f8a-2f2b17823831 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.572244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae55c-a276-4983-8f8a-2f2b17823831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.628899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e0dae55c-a276-4983-8f8a-2f2b17823831 None None] MFA Rules not processed for user `f54adb8f91504bd1bc9e2c785bfba6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:04:25.630118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e0dae55c-a276-4983-8f8a-2f2b17823831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.705666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 582/1179] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:04:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:04:25.718833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.719150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.719431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.721281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 598/1180] 10.222.0.20 () {54 vars in 963 bytes} [Sun Oct 23 00:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:04:25.726125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee518-3c21-4459-a680-346f9c5ec3ab None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:25.726522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee518-3c21-4459-a680-346f9c5ec3ab None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:25.726896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee518-3c21-4459-a680-346f9c5ec3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:25.759913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:25.804344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fe9ee518-3c21-4459-a680-346f9c5ec3ab None None] MFA Rules not processed for user `587f9cc7c6714a718e19a10d1d6b6385`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:04:25.805528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fe9ee518-3c21-4459-a680-346f9c5ec3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.879142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 583/1181] 10.222.0.20 () {58 vars in 1060 bytes} [Sun Oct 23 00:04:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:04:25.886910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:25.888435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:25.939281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:25.993083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350350d9-708a-4d87-8b19-675f857a9809 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:26.065975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:26.066574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:26.066854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:26.067149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:26.068737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:26.164827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:26.166230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:26.169664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:26.184359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 599/1182] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:04:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:04:26.229559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4e62-f3e2-481d-95d8-3529bb66172f None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:26.229841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4e62-f3e2-481d-95d8-3529bb66172f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:26.230111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4e62-f3e2-481d-95d8-3529bb66172f None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:26.231401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 584/1183] 10.222.0.20 () {52 vars in 830 bytes} [Sun Oct 23 00:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:04:26.234940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:26.236182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:26.332793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c3d0-8f43-4dbd-963c-df654476c4c9 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:26.424650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:26.425535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:26.425810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:26.426083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] PATH_INFO: `/v3/users/f54adb8f91504bd1bc9e2c785bfba6b6` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:26.438616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54adb8f91504bd1bc9e2c785bfba6b6)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:26.440169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:04:26.440169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 23 00:04:26.440169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 23 00:04:26.441380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:26.450851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:26.507183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54adb8f91504bd1bc9e2c785bfba6b6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:26.507819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54adb8f91504bd1bc9e2c785bfba6b6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:26.516505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54adb8f91504bd1bc9e2c785bfba6b6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:26.540763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54adb8f91504bd1bc9e2c785bfba6b6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:26.555329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54adb8f91504bd1bc9e2c785bfba6b6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:26.561007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 600/1184] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:04:26 2022] DELETE /identity/v3/users/f54adb8f91504bd1bc9e2c785bfba6b6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:04:26.565984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:26.566445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:26.566536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:26.622333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:04:26.623475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:26.699398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:26.711921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 585/1185] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:04:26.722345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:26.723689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:26.821791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22204c36-999f-46ed-92fb-09f8f5941199 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:26.874614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:26.896333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:26.896939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:26.897219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:26.897491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:26.899063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:27.004790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:27.006208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd4c78-c2bf-41ba-b99b-6c7d81ccb6db service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:27.024196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 601/1186] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:04:27.372990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:04:27.374312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:04:27.386041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dfc5-5dab-4d09-be08-797e75d20df6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:04:27.483647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:04:27.484277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:04:27.484554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:04:27.484822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] PATH_INFO: `/v3/projects/ab994cc8c691499384da972843ab1439` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:04:27.494422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab994cc8c691499384da972843ab1439)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:04:27.495456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:04:27.495456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:04:27.495456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:04:27.496650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:04:27.554036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab994cc8c691499384da972843ab1439', 'request_id': 'req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:27.565758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab994cc8c691499384da972843ab1439', 'request_id': 'req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:27.572655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab994cc8c691499384da972843ab1439', 'request_id': 'req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:27.601878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] The token cache is being invalidate because project ab994cc8c691499384da972843ab1439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:04:27.602151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:27.602671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e41457a-c2b0-4151-9f7a-d51dcbdf56f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:04:27.603992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 586/1187] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:04:27 2022] DELETE /identity/v3/projects/ab994cc8c691499384da972843ab1439 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:04:37.021910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=62 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:04:37.599900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:05:59.921598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:05:59.922180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:05:59.922180 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:05:59.923540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 602/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:05:59.929142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf97-e830-4d50-9ed3-93c3750f3f49 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:05:59.929583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf97-e830-4d50-9ed3-93c3750f3f49 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:05:59.929686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf97-e830-4d50-9ed3-93c3750f3f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:00.008144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-820ecf97-e830-4d50-9ed3-93c3750f3f49 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:00.009339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-820ecf97-e830-4d50-9ed3-93c3750f3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:00.113399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 587/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:00.268433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:00.271110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:00.389233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188518d2-1b15-41ab-bdf3-92400f63b332 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:00.394680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:00.395841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:00.396122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:00.396393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:00.404336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:00.405910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2381-654a-4e8a-b5fd-29484667303b service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:00.415702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 603/1190] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:01.490445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cb7c-6bf1-4fc9-a1f0-408e39ccffe4 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:01.490976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cb7c-6bf1-4fc9-a1f0-408e39ccffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:01.490976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cb7c-6bf1-4fc9-a1f0-408e39ccffe4 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:01.492939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 588/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:01.497803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66313-c7f2-4b63-9064-072c707abac2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:01.498264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66313-c7f2-4b63-9064-072c707abac2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:01.498369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66313-c7f2-4b63-9064-072c707abac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:01.517311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4fe66313-c7f2-4b63-9064-072c707abac2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:01.518535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4fe66313-c7f2-4b63-9064-072c707abac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:01.526509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 604/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:01.683852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050cb7c-6bf1-4fc9-a1f0-408e39ccffe4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:01.698046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050cb7c-6bf1-4fc9-a1f0-408e39ccffe4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:01.703435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:01.704034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:01.704310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:01.704584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:01.712632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:01.714213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27703-1737-4713-be96-3aee52abbea2 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:01.723943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 589/1193] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:01.837327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e591-73c7-45b9-9498-6f2be6781b84 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:01.837617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e591-73c7-45b9-9498-6f2be6781b84 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:01.837893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3e591-73c7-45b9-9498-6f2be6781b84 None None] PATH_INFO: `/v3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:01.839272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 605/1194] 10.222.0.16 () {54 vars in 925 bytes} [Sun Oct 23 00:06:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:06:01.846109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1c7f-5139-44e1-94cd-6db1f28d686e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:01.846551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1c7f-5139-44e1-94cd-6db1f28d686e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:01.846826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1c7f-5139-44e1-94cd-6db1f28d686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:01.907498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-224f1c7f-5139-44e1-94cd-6db1f28d686e None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:01.908748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-224f1c7f-5139-44e1-94cd-6db1f28d686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:01.926329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:01.981736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 590/1195] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Oct 23 00:06:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:05.619821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c4e2-c298-47ec-bfb3-ce3c4df1e956 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:05.620296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c4e2-c298-47ec-bfb3-ce3c4df1e956 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:05.620400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c4e2-c298-47ec-bfb3-ce3c4df1e956 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:05.621683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 606/1196] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:05.626607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19e29-88d4-4aa5-bf79-c7bf65f9dc5a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:05.627025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19e29-88d4-4aa5-bf79-c7bf65f9dc5a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:05.627183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19e29-88d4-4aa5-bf79-c7bf65f9dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:05.651890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-03a19e29-88d4-4aa5-bf79-c7bf65f9dc5a None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:05.653077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-03a19e29-88d4-4aa5-bf79-c7bf65f9dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:05.661494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 591/1197] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:06:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:05.670075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567c4e2-c298-47ec-bfb3-ce3c4df1e956 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:05.684318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567c4e2-c298-47ec-bfb3-ce3c4df1e956 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:05.689607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:05.690209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:05.690488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:05.690762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:05.699305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:05.700863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b711c-0eee-4ace-9d5c-09dbcff9226d service placement] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:05.710698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 607/1198] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:13.183275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57246-2d5e-4160-8371-6e2cf9d58c4a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:13.183841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57246-2d5e-4160-8371-6e2cf9d58c4a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:13.183841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e57246-2d5e-4160-8371-6e2cf9d58c4a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:13.185171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 592/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:13.189893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b4cb-2bdd-41c9-9c68-424a82705f94 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:13.190288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b4cb-2bdd-41c9-9c68-424a82705f94 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:13.190444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077b4cb-2bdd-41c9-9c68-424a82705f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:13.211453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2077b4cb-2bdd-41c9-9c68-424a82705f94 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:13.212659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2077b4cb-2bdd-41c9-9c68-424a82705f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:13.220535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 608/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:13.374409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e57246-2d5e-4160-8371-6e2cf9d58c4a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:13.389198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e57246-2d5e-4160-8371-6e2cf9d58c4a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:13.394628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:13.395256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:13.395537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:13.395810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:13.404236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:13.405805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4175b-f05f-4fbe-bd63-15decc003008 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:13.414993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 593/1201] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:14.475541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cf63-c739-4db5-abcb-115f741640dd None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:14.476102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cf63-c739-4db5-abcb-115f741640dd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:14.476102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cf63-c739-4db5-abcb-115f741640dd None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:14.477446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 609/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:14.482072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe40ab-206f-4d2f-8f95-e93a08349255 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:14.482471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe40ab-206f-4d2f-8f95-e93a08349255 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:14.482610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe40ab-206f-4d2f-8f95-e93a08349255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:14.502399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-86fe40ab-206f-4d2f-8f95-e93a08349255 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:14.503609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-86fe40ab-206f-4d2f-8f95-e93a08349255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:14.512077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 594/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:14.660323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847cf63-c739-4db5-abcb-115f741640dd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:14.674855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847cf63-c739-4db5-abcb-115f741640dd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:14.680792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:14.681381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:14.681659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:14.681932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:14.689857 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:14.691440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d88fad-6a7d-4f83-b687-5fa45c6f6401 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:14.701164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 610/1204] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:18.605424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:18.605956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:18.606054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:18.607408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 595/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:18.612703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cccd5-0257-44e7-ae16-a8a86b4a6e20 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:18.613143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cccd5-0257-44e7-ae16-a8a86b4a6e20 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:18.613249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cccd5-0257-44e7-ae16-a8a86b4a6e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:18.632861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2b8cccd5-0257-44e7-ae16-a8a86b4a6e20 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:18.634051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2b8cccd5-0257-44e7-ae16-a8a86b4a6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:18.641726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 611/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:18.931280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:18.933069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:19.011607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0707-9aa7-4e9d-b66c-dc73080681b6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:19.015192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:19.015777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:19.016053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:19.016322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:19.025039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:19.026462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630e859-3e63-4e42-a824-78d2aa62bc77 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:19.035780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 596/1207] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:21.179340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dd0e-eac7-4202-bd6f-9d49f8b5e683 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:21.179912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dd0e-eac7-4202-bd6f-9d49f8b5e683 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:21.180022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dd0e-eac7-4202-bd6f-9d49f8b5e683 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:21.181323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 612/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:21.186449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad01a6-13dc-40ac-bb55-2989d4a76da8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:21.186864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad01a6-13dc-40ac-bb55-2989d4a76da8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:21.186984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad01a6-13dc-40ac-bb55-2989d4a76da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:21.206788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-61ad01a6-13dc-40ac-bb55-2989d4a76da8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:21.208028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-61ad01a6-13dc-40ac-bb55-2989d4a76da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:21.215978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 597/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:21.505142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dd0e-eac7-4202-bd6f-9d49f8b5e683 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:21.516690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dd0e-eac7-4202-bd6f-9d49f8b5e683 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:21.520340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:21.520948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:21.521231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:21.521511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:21.530570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:21.532013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60014e-e989-4ae2-b062-ea7ca54f9079 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:21.541329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 613/1210] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:06:25.052710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:25.053275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:25.053275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:25.054601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 598/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:25.059714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9129b-b5d5-4231-b4a5-030b541eb742 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:25.060103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9129b-b5d5-4231-b4a5-030b541eb742 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:25.060273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9129b-b5d5-4231-b4a5-030b541eb742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:25.079232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d5d9129b-b5d5-4231-b4a5-030b541eb742 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:25.080421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d5d9129b-b5d5-4231-b4a5-030b541eb742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:25.088645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 614/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:25.389371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:25.391052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:25.454939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:25.468940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5e252-90b7-4f0b-911d-e1c07b7a4150 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:25.472512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:25.473114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:25.473391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:25.473663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:25.482447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:25.483887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274ff0-e623-46b3-a5e0-1b5c4cc4708c service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:25.493147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 599/1213] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:27.621610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:27.622153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:27.622153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:27.623521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 615/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:06:27.628672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d58ce-f09a-409f-a495-a86abad01dbc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:27.629088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d58ce-f09a-409f-a495-a86abad01dbc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:27.629230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d58ce-f09a-409f-a495-a86abad01dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:27.649599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c62d58ce-f09a-409f-a495-a86abad01dbc None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:06:27.650785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c62d58ce-f09a-409f-a495-a86abad01dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:27.658550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 600/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:06:27.962733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:06:27.964416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:06:27.972347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=84 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:27.978926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c53ba-e706-49c6-a5a8-ad6cff8ba1fd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:06:27.982402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:06:27.982991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:06:27.983301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:06:27.983572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:06:27.992797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:06:27.994242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700a1bf-186c-436a-9922-44b46c79e0e4 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:06:28.003420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 616/1216] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:06:37.644126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=11 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:06:37.999387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:56.645951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331b43-b8bb-4464-88c9-22cdd2965bb6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.647129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331b43-b8bb-4464-88c9-22cdd2965bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.647645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331b43-b8bb-4464-88c9-22cdd2965bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.650549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537cc5-0056-4a9d-8b07-070b95ed61ab None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.651094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537cc5-0056-4a9d-8b07-070b95ed61ab None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.651094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b537cc5-0056-4a9d-8b07-070b95ed61ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.682875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-03331b43-b8bb-4464-88c9-22cdd2965bb6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.684614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-03331b43-b8bb-4464-88c9-22cdd2965bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:56.686335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9b537cc5-0056-4a9d-8b07-070b95ed61ab None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.687588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9b537cc5-0056-4a9d-8b07-070b95ed61ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:56.700633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 601/1217] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:56.705636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 617/1218] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 23 00:07:56.711814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.712612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.713119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.719097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.719097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.719097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.748689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.749955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:56.753608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.754795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:56.763146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 602/1219] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:56.768351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:56.780917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 618/1220] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:07:56.783868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f45e6f-6010-4fa1-92a6-202107917600 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:56.785594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:56.793447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:56.794081 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.794422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.794697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.795383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:56.795686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:56.797527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:56.804759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0221-3e5f-44bd-b2f8-f17601abb446 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:56.814596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:56.815273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.815552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.815826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.817066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:56.817374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:56.819044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:07:56.819044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 23 00:07:56.819044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 23 00:07:56.819976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:56.824255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 603/1221] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:56.832359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:56.840185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 619/1222] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:07:56.849549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:56.850315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8900649-1dd7-40ac-a683-5ab7ec746ac2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:56.859183 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:56.859805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.860090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.860362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.861013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:56.862033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:07:56.862033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:07:56.862033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:07:56.863348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c4d84-8699-4d14-acad-c8d1adfcee1d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:56.867466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c6fb-dd0e-49e4-bd13-40f42d23a027 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:56.879755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:56.880557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.880844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.881114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.881752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:56.883670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e25433-4b8b-472b-846f-7834baf06694 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:56.928532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 604/1223] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:07:56.930305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.930601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.930879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.944273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 620/1224] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:07:56.945562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:56.945846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:56.946119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:56.960195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.961514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:56.987471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:56.988775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.057565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 605/1225] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.058441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.075776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d485-7863-4869-b033-9c8b3dc5815a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.080392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.080992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.081264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.081631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.082789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.084117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 621/1226] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.084671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874424fe-4d8e-4667-9812-d9549a524ed4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.084935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.095326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd8fd1-a19d-4f7a-87df-e61812b125e1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.100517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.101129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.101406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.101681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.102313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.103357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:07:57.103357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 23 00:07:57.103357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 23 00:07:57.104589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962061ea-0fe3-444a-b9f0-4e4b7ccf6e6c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.107168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 606/1227] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.110184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d36aee-9777-4922-9e33-a682a6978ec6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.110184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d36aee-9777-4922-9e33-a682a6978ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.110184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d36aee-9777-4922-9e33-a682a6978ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.126508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 622/1228] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.127902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263588f4-f50f-452d-a668-07fc5fa6e034 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.128186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263588f4-f50f-452d-a668-07fc5fa6e034 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.128991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263588f4-f50f-452d-a668-07fc5fa6e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.129177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-33d36aee-9777-4922-9e33-a682a6978ec6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.130377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-33d36aee-9777-4922-9e33-a682a6978ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.139159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 607/1229] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.144456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69e41-17fe-4302-b4a4-f695af8afa07 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.144819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69e41-17fe-4302-b4a4-f695af8afa07 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.145017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69e41-17fe-4302-b4a4-f695af8afa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.148732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-263588f4-f50f-452d-a668-07fc5fa6e034 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.150012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-263588f4-f50f-452d-a668-07fc5fa6e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.158256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 623/1230] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.159409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981be5b-d132-4ff5-b808-f17d07ebc290 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.160232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981be5b-d132-4ff5-b808-f17d07ebc290 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.160508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981be5b-d132-4ff5-b808-f17d07ebc290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.164932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fed69e41-17fe-4302-b4a4-f695af8afa07 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.166111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fed69e41-17fe-4302-b4a4-f695af8afa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.174889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 608/1231] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.176147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.176422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.176681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.180333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c981be5b-d132-4ff5-b808-f17d07ebc290 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.181536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c981be5b-d132-4ff5-b808-f17d07ebc290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.190127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 624/1232] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.190716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.191035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.191341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.196249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.197520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.205547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 609/1233] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.206312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.212988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.214289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.220593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4a0f1-b51c-4677-a6cb-cb86a5f5eff0 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.223687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 625/1234] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.224252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.230300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.230898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.231182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.231452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.232099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.233703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174813f-cc6f-4471-bec1-a6da6f6dbbdc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.234431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72593-7f2d-4b18-b46f-eb4a046d2126 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.239059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.239681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.239958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.240230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.240989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.242551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248057-afc6-44a1-8525-d90baf2232ae admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.247244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 610/1235] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:57.247244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f302-a094-46b2-b737-1fa874285217 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.247244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f302-a094-46b2-b737-1fa874285217 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.247244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f302-a094-46b2-b737-1fa874285217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.253039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 626/1236] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:57.254729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.255025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.255325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.266905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1d20f302-a094-46b2-b737-1fa874285217 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.268130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1d20f302-a094-46b2-b737-1fa874285217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.274479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.275674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.276531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 611/1237] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.277679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb82b5-18ca-41e9-a3b1-28cfa87eba35 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.278240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb82b5-18ca-41e9-a3b1-28cfa87eba35 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.278513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb82b5-18ca-41e9-a3b1-28cfa87eba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.284417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 627/1238] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.285747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.296360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be44f-5074-4992-9fe1-0ee5914aed8c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.298901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e7bb82b5-18ca-41e9-a3b1-28cfa87eba35 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.300164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e7bb82b5-18ca-41e9-a3b1-28cfa87eba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.301297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.301894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.302177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.302454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.303156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.303463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.305028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.308647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 612/1239] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.309888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.310174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.310448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.322716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 628/1240] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.322716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.330552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:57.332321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:57.333057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d864f-e0d1-4f0f-884d-4f96308deea6 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.337497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.338082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.338359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.338629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.339287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.339590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.340168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 613/1241] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:57.340942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.341159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.352846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ea34-1e0c-429a-bbc3-b7778c132ed6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.353354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 629/1242] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.354072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.357801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.358396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.358678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.358950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.359612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.361210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.365576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f747-b456-4d1f-9a2b-d7999bc014b0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.370116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.370701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.370974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.371279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.371908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.375318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 614/1243] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:57.375318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.375563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.383689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 630/1244] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:57.384684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e6d38-c317-4882-b8fb-46dfee31fa85 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.384818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.389420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.389907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.390182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.390916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.391125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.391426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.392987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.394686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a96d-5692-4eb7-b08d-a8510769c480 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.399291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.399868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.400153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.400430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.401059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.401360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.402903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.405492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 615/1245] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.406342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.414983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 631/1246] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.415665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.422560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843156a3-94e4-44ac-bda7-0a5a04255445 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.427038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c1b1-0ea0-4824-9803-c1e43ca4b7e3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.430329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.430935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.431248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.431521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.431708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.432158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.432289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.432464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.432569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.432823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.433436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.434052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.435324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.439924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:57.441164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:57.454524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 616/1247] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.454524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.460059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e776b-9ed4-4290-8814-e6ba802f769b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.465172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 632/1248] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.465327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.465784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.466006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.466111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.466336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.467049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:07:57.467398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.469214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.481882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 617/1249] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:07:57.482650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.492158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abdd10-ede3-4ca2-b19d-5890bb744686 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.537006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92dd4-2d6a-45ca-b997-fa17ce557230 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.541621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.542230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.542513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.542785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.543449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.545471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.553813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.554482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.554789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.555066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] PATH_INFO: `/v3/projects/b8569959517e4cfba16274cfc9685921/users/5a0c89cb1e5349f681fc74f191ad9725/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.570055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8569959517e4cfba16274cfc9685921, user_id=5a0c89cb1e5349f681fc74f191ad9725, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.572072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 633/1250] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.572862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.572975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.585911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 618/1251] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:57 2022] PUT /identity/v3/projects/b8569959517e4cfba16274cfc9685921/users/5a0c89cb1e5349f681fc74f191ad9725/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:57.586809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.639178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bc7c4-8624-48f1-97b1-7107f054b6dc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.649318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda694-7c27-4c2c-a182-822a727b5999 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.653930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.654533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.654812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.655093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.655731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.657646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.685566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 619/1252] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.686341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.698793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.699489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.699772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.700046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] PATH_INFO: `/v3/projects/e506ce73a94e41639f8640865d0fa13b/users/5ba37660a05e44f5a7f10946e79cb250/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.714255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e506ce73a94e41639f8640865d0fa13b, user_id=5ba37660a05e44f5a7f10946e79cb250, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.717208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.726438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:57.732113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 634/1253] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:57 2022] PUT /identity/v3/projects/e506ce73a94e41639f8640865d0fa13b/users/5ba37660a05e44f5a7f10946e79cb250/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:57.733061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.742564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:57.756227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7baf9-93ee-403d-9d0e-e02495b87851 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.794650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372f5bb-f577-4d83-b143-c11201f02a5f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.799522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.800126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.800740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.801312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.802421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.804467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.812266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.812875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.813149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.813416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.814043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.816476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.834862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 635/1254] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.834862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.844430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 620/1255] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.845376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.896618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29ddf-f650-49ef-8ff7-4e311210c549 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.906464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4da66-e11a-4c5f-a0f9-cfcfaba9ee33 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:57.911847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.912461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.912733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.913008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.913638 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.915588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.946261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 621/1256] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.946261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:57.953899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:57.954514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.954794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.955067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:57.955718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:57.958159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce2cf9-86fb-411c-91d1-54fa48926aa2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:57.979584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 636/1257] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:57.982698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bbf9-a861-4820-bab5-b696d865476a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:57.982698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bbf9-a861-4820-bab5-b696d865476a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:57.982698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bbf9-a861-4820-bab5-b696d865476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.009770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0dd6bbf9-a861-4820-bab5-b696d865476a None None] MFA Rules not processed for user `5a0c89cb1e5349f681fc74f191ad9725`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:58.010989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0dd6bbf9-a861-4820-bab5-b696d865476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:58.015334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358bd7c-f9c2-4ae8-bd59-59afa91004d8 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.020525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.020668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.021128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.021407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.021726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.022474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.024447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.041159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.051587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 622/1258] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.051587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.061600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b77b-a96a-4564-afd4-d78e06accc6f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.066255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.066848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.067162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.067438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.068063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.069966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.078173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 637/1259] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:58.079430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.079716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.079988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.095903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 623/1260] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.096732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.100362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:58.101556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:58.110453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 638/1261] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:58.111310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac07a8-8cce-423b-b586-157b39e29513 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.111536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.121189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.121807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.122089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.122358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.122992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac284a-309b-4dad-b92d-30ada339e17a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.123151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.124975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.127905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.128529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.129328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.129597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.130216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.132143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.149192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 624/1262] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.149959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.156281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 639/1263] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.156281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.160227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f7524-a4ad-4888-a169-35971e06163b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.164989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cc1f7-eea3-4e34-a1fe-d7484fdb02b9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.165125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.165636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.165943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.166244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.166863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.168886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.169865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.170496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.170771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.171041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.171695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.173237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.184418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 640/1264] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.185295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.190777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 625/1265] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.192213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.197559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f2304-bb71-4e8d-b22e-7dd02479c99a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.202116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.202714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.202994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.203282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.203906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.204348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0556d-dcc1-489f-9b9d-8c3c41487cea admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.205466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.209108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.209691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.209970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.210243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.210887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.212808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.216218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 641/1266] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.219922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.229564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ec2a1-5f4f-42b1-8778-616494f6aee5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.234191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.234800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.235051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.235349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.235973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.237519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.245316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 626/1267] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.245316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.253417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 642/1268] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.253417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.261116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3023e2-f9e5-4d87-83eb-fa899f43b126 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.299501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15017e-90ca-4206-8256-0dd473f80d76 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.303528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.304156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.304431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.304698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.319699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.320308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.320588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.320856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.321489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.323060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.332698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 643/1269] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.336057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.347064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c27f-abf4-4e6e-9575-09568c238f03 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.353099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.353685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.353963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.354234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.354890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.356519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.365061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.366497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.367172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 644/1270] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.367788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.376537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 627/1271] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:58.377070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e30eb-f516-4526-a260-04ac80fbb020 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.377393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.382313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.382903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.383294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.383633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.384206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.385777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.389117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6564-fe06-4542-8671-0376fe0e065f service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.395602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.396204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.399732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.399858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 645/1272] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.399958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.399958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.400107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.400189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.407989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885012d-5c4a-4c62-8960-743eb82581ec admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.413840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 628/1273] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.413840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.416497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.417287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.417646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.417992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.418791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.420462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.424091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f282d-fb76-4281-b8e6-5e2a80bec79b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.428985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.429667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.430050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.430384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.431093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.431855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 646/1274] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.432594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.433238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.443142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffe696-78d6-4f0f-a96c-ddabae3f27dd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.449570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.450378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.450764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.451134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.451839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.453485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.458311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 629/1275] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:58.460246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.465710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 647/1276] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.466546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.473216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dda81-a190-4aed-91b7-c9f3111d6c25 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.480102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.480381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69542bba-b591-49f3-a9e7-59725280a578 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.480718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.480998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.481273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.481985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.483769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.485233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.486927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.487614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.488055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.488419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.489160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.490790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.492442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.501133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 630/1277] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.501133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.504530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 648/1278] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.505477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.516613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d8ff3-097a-4a62-a7a6-8f3b7e9d57f3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.521791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.522604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.523317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.523317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] PATH_INFO: `/v3/projects/da54fddf264949ca958df153c033438a/users/db8a7662772f4ac69378d3f33e5e6098/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.528141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d767-9691-444a-bdf4-f57926fb6eaa admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.534284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.537024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.537564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.538013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.539098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.542113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.548777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da54fddf264949ca958df153c033438a, user_id=db8a7662772f4ac69378d3f33e5e6098, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.551547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.557759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 649/1279] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.561996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.577345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 631/1280] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/da54fddf264949ca958df153c033438a/users/db8a7662772f4ac69378d3f33e5e6098/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.578246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c277-5e20-4a38-8d09-2750cac1794b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.578378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.645140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.645801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.646080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.646518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] PATH_INFO: `/v3/projects/abf73f3d9fc74a9fa2c47127b948b3ea/users/4053765239cc4f98ac3513dd88c85693/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.651854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0d8a-97b5-4988-8818-aef05a756b5d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.657425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.658314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.658669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.658955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.660297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.661977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.664942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf73f3d9fc74a9fa2c47127b948b3ea, user_id=4053765239cc4f98ac3513dd88c85693, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.667746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.673875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 632/1281] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:58.674891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.685104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d846b-f99b-45a4-a2fd-a6b06cb0b0c2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.686635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 650/1282] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/abf73f3d9fc74a9fa2c47127b948b3ea/users/4053765239cc4f98ac3513dd88c85693/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.687222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.762316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2cd4-b5d7-4fb7-b37f-5b15be599083 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.762946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.763908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.764247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.764522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] PATH_INFO: `/v3/projects/ac30fa3ea0dd45c290b47780b39fbff3/users/a925c18e67894c06863e68b2793488d9/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.770188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.771316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.771835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.772843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] PATH_INFO: `/v3/projects/a08d8f10be91431fa9c0fe51e953f28a/users/a8eddc1a05c14b26acaf7997784f9d0d/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.782686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac30fa3ea0dd45c290b47780b39fbff3, user_id=a925c18e67894c06863e68b2793488d9, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.786261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.791703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08d8f10be91431fa9c0fe51e953f28a, user_id=a8eddc1a05c14b26acaf7997784f9d0d, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.794780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.810971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 633/1283] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/ac30fa3ea0dd45c290b47780b39fbff3/users/a925c18e67894c06863e68b2793488d9/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.816218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.816820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 651/1284] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/a08d8f10be91431fa9c0fe51e953f28a/users/a8eddc1a05c14b26acaf7997784f9d0d/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.818212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.879435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.891034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609128e-580f-4f60-bd08-c98c004515fd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.894580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:58.898267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.899052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.899381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.899679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] PATH_INFO: `/v3/projects/864af6afedd94073aa6cb2c197509210/users/e9794dc24e24452294f5e04d0fba042e/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.908447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd4531-3300-4122-a011-6661376aaa56 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:58.914472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:58.915326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.915706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.916093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] PATH_INFO: `/v3/projects/2fa7823300094dec95498e80881add85/users/a45743a8031147a8beb674c88279aeea/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.918259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=864af6afedd94073aa6cb2c197509210, user_id=e9794dc24e24452294f5e04d0fba042e, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.921177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ff2f-ad8c-4881-ae1d-bcadfd0d05ae admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.934532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa7823300094dec95498e80881add85, user_id=a45743a8031147a8beb674c88279aeea, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:58.937497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 652/1285] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/864af6afedd94073aa6cb2c197509210/users/e9794dc24e24452294f5e04d0fba042e/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.937631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:58.938559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442ff8-fe1c-489f-9363-56924612c75d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:58.938845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442ff8-fe1c-489f-9363-56924612c75d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:58.939199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442ff8-fe1c-489f-9363-56924612c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:58.954840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 634/1286] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/2fa7823300094dec95498e80881add85/users/a45743a8031147a8beb674c88279aeea/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:58.962708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:58.963987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b6442ff8-fe1c-489f-9363-56924612c75d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:58.965448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b6442ff8-fe1c-489f-9363-56924612c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.030875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 653/1287] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.036277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51304f9-723a-45d9-b83f-5b184759f2e4 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.036633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a6db-c275-4577-ba3e-d60e6d8ac6f6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.036886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51304f9-723a-45d9-b83f-5b184759f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.037319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51304f9-723a-45d9-b83f-5b184759f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.041921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.042588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.043062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.043292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] PATH_INFO: `/v3/projects/5d40b23db8b34919b4a0451433d6923c/users/e5893141eb3f414abdb4e684a6a7db79/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.058774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f51304f9-723a-45d9-b83f-5b184759f2e4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.060112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f51304f9-723a-45d9-b83f-5b184759f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.061052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d40b23db8b34919b4a0451433d6923c, user_id=e5893141eb3f414abdb4e684a6a7db79, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.064375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97925c-d660-412e-8990-1f3336062ed5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.069022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 654/1288] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.070047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645091-8b83-4a8f-9b79-55b0d43e56ad None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.070327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645091-8b83-4a8f-9b79-55b0d43e56ad None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.070596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645091-8b83-4a8f-9b79-55b0d43e56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.090818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 635/1289] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:58 2022] PUT /identity/v3/projects/5d40b23db8b34919b4a0451433d6923c/users/e5893141eb3f414abdb4e684a6a7db79/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:59.091614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0a645091-8b83-4a8f-9b79-55b0d43e56ad None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.092899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c292a-9723-4c65-a44f-245c9a075a1b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.093047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0a645091-8b83-4a8f-9b79-55b0d43e56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.093238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c292a-9723-4c65-a44f-245c9a075a1b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.093459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c292a-9723-4c65-a44f-245c9a075a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.115466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-463c292a-9723-4c65-a44f-245c9a075a1b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.116365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-463c292a-9723-4c65-a44f-245c9a075a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.168447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 655/1290] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.173683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.174142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.174669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.186726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 636/1291] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.188147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.188504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.188774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.199427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.200751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.212451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 656/1292] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.213469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.214837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.233364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] MFA Rules not processed for user `a45743a8031147a8beb674c88279aeea`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.235592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.288222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a08c3-ef86-4b6b-922c-ceee0e50b510 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.292479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.293096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.293377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.293698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.308742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.310988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.320992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:59.326349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 657/1293] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:59.327657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.333968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:07:59.338313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efbdc1-7a54-4206-a1b5-5e7c888e715f service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.343738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.344666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.345233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.345766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.355275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 637/1294] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.356277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.361096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.363041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.368233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b288a5-f68c-4ab4-85e6-4605e6d252cc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.373525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.374254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.374551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.374823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.375513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 658/1295] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:59.376406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.376769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.378982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.385344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89282-1170-4720-93de-dd46c21453b6 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.389238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.389903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.390254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.390599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.390982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 638/1296] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:59.392171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.403691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450fcc-396d-4c5e-9541-54709d7007e0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.404936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.405944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.413952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.414648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.415136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.415496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.421284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 659/1297] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:59.422147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.426983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.428657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.434465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4c0a1-d6f1-4b3c-97c9-f712c3dd2b37 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.440019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 639/1298] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:59.440904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.441573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.442500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.443065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.443534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.451833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00401f-30e7-424b-a603-2adc94f2023b service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.454264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.455893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.458085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.458838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.459257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.459968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.460302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.463466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.469935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 660/1299] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:07:59.471779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.485548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2034338-6309-47d5-bd5f-be56fb10df66 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.493318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.494416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.495417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.495914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] PATH_INFO: `/v3/projects/5d40b23db8b34919b4a0451433d6923c/users/e5893141eb3f414abdb4e684a6a7db79/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.500553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d40b23db8b34919b4a0451433d6923c, user_id=e5893141eb3f414abdb4e684a6a7db79, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.510395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476d88-2eb6-4f7c-ad3d-ae798f2d18a5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.524952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 640/1300] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:59.526051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.539425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 661/1301] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:59 2022] PUT /identity/v3/projects/5d40b23db8b34919b4a0451433d6923c/users/e5893141eb3f414abdb4e684a6a7db79/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:59.556533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.557263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.557263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.611412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] MFA Rules not processed for user `e5893141eb3f414abdb4e684a6a7db79`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:07:59.614521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:07:59.659839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ebef-0116-498d-88e3-a9ac0a62b88f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.776597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 662/1302] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:07:59.786918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.787156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.787825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.788212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.788622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.791175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.798792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.844822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 641/1303] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:07:59 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:07:59.851196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.863690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66a0c-d2d1-4486-9d63-f932416fae23 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.868839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.869434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.869768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.870097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.872485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.873534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.880137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944edd-98c9-45bf-8b36-040f9dcd161c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.886434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.887571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.888918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.889438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.890462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 642/1304] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:07:59.891914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.907651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0be29-b047-42fb-9d87-435c84891d14 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:07:59.908333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.910947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.913707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:07:59.914569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:07:59.914811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:07:59.915106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] PATH_INFO: `/v3/projects/10ff32e6a0264adeab76f1b88c9230ff/users/91d58b48453d471fb6378a1aeadd6b00/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:07:59.927493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 663/1305] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:07:59.934730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ff32e6a0264adeab76f1b88c9230ff, user_id=91d58b48453d471fb6378a1aeadd6b00, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:07:59.937835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:07:59.962286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 643/1306] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:07:59 2022] PUT /identity/v3/projects/10ff32e6a0264adeab76f1b88c9230ff/users/91d58b48453d471fb6378a1aeadd6b00/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:07:59.966621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:07:59.985764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546255a-629e-473a-9919-caa2bf23d7b8 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:00.037705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:00.043758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:00.109867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:00.178002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:00.178760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:00.179066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:00.179362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:00.180016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:00.183014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:00.201354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c19e45-cf06-4c2e-a023-4b9d8d6c15e8 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:00.211309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 664/1307] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:00.212757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:00.215335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:00.216033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:00.216317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:00.216658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:00.236740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d36bf-3aee-4637-8ee6-2a1260839bfe admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:00.253035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:00.253775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:00.254050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:00.254319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] PATH_INFO: `/v3/projects/10ff32e6a0264adeab76f1b88c9230ff/users/91d58b48453d471fb6378a1aeadd6b00/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:00.258265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ff32e6a0264adeab76f1b88c9230ff, user_id=91d58b48453d471fb6378a1aeadd6b00, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:00.263064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe81483-24c8-4a8e-8ab6-4c2ad3eb0373 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:00.296079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 665/1308] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:00 2022] PUT /identity/v3/projects/10ff32e6a0264adeab76f1b88c9230ff/users/91d58b48453d471fb6378a1aeadd6b00/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:00.297632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:00.297921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:00.300843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:00.344474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:00.347278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:00.368199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] MFA Rules not processed for user `91d58b48453d471fb6378a1aeadd6b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:00.368199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:00.372246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 644/1309] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:00.504856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 666/1310] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:00.511140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:00.521082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5d555-55e9-432b-b61a-4983b2eba336 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:00.686136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:00.686849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:00.687795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:00.688747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:00.702460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:00.704338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14f87-cc58-4b18-9b8b-3d9e970bc66a service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:00.729871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 645/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:01.676482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:01.836786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ede5d-5ae7-4588-9c39-c0be9ffedfe0 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:01.849018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:01.851289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:01.851860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:01.861558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] PATH_INFO: `/v3/users/a45743a8031147a8beb674c88279aeea` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:01.864404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45743a8031147a8beb674c88279aeea)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:01.868493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:01.967984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45743a8031147a8beb674c88279aeea'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:01.970188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45743a8031147a8beb674c88279aeea'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:01.976679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:01.989593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45743a8031147a8beb674c88279aeea'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:02.013831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45743a8031147a8beb674c88279aeea'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:02.037770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45743a8031147a8beb674c88279aeea'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:02.050156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 667/1312] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:01 2022] DELETE /identity/v3/users/a45743a8031147a8beb674c88279aeea => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:02.051574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:02.052032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:02.052144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:02.075334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:02.076634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:02.196274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:02.224878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 646/1313] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:02.286601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:02.288988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:02.381163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b620-ab7f-468a-a0ac-d883ccb687d8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:02.386732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:02.387555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:02.387906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:02.388298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:02.400788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:02.402843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d717321-4a06-4a62-b31d-12a261d4252f service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:02.420639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 668/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:03.883025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:03.884819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:03.906107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b1566-67c9-4d2f-a128-cd9d10baea6f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:03.917740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:03.919053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:03.919566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:03.921324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] PATH_INFO: `/v3/projects/2fa7823300094dec95498e80881add85` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:03.922884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa7823300094dec95498e80881add85)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:03.931938 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.084588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.085187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.085555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.093453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa7823300094dec95498e80881add85', 'request_id': 'req-42f9de6d-512a-4b53-9301-ea9579b24589'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.105775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa7823300094dec95498e80881add85', 'request_id': 'req-42f9de6d-512a-4b53-9301-ea9579b24589'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.131816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa7823300094dec95498e80881add85', 'request_id': 'req-42f9de6d-512a-4b53-9301-ea9579b24589'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.155739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] MFA Rules not processed for user `4053765239cc4f98ac3513dd88c85693`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:04.158499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:04.169030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] The token cache is being invalidate because project 2fa7823300094dec95498e80881add85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:04.173123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.178550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.181631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 647/1315] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:03 2022] DELETE /identity/v3/projects/2fa7823300094dec95498e80881add85 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:04.185852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.192425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:04.275720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 669/1316] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:04.291338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.293211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:04.333945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9de6d-512a-4b53-9301-ea9579b24589 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:04.340485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:04.341303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.341679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.342641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] PATH_INFO: `/v3/users/91d58b48453d471fb6378a1aeadd6b00` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.344578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d58b48453d471fb6378a1aeadd6b00)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:04.345987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: WARNING py.warnings [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:08:04.345987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: warnings.warn(msg) Oct 23 00:08:04.345987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: Oct 23 00:08:04.348436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.397802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9b37d-1db1-4fdc-a642-bae7de907fca None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:04.403685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:04.404633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.405084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.405630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.406542 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:04.411392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.417589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:04.470879 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 670/1317] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:04 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:04.475241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.478769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d58b48453d471fb6378a1aeadd6b00'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.497158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d58b48453d471fb6378a1aeadd6b00'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.512690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d58b48453d471fb6378a1aeadd6b00'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.574723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d58b48453d471fb6378a1aeadd6b00'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.578342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d58b48453d471fb6378a1aeadd6b00'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:04.592921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 648/1318] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:04 2022] DELETE /identity/v3/users/91d58b48453d471fb6378a1aeadd6b00 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:04.601984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918dbb9-f9ad-41af-ab3f-59c777a44189 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:04.722458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:04.723537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.724710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.725191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.726034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:04.730253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.768699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 671/1319] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:04 2022] POST /identity/v3/users => generated 309 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:04.772933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.774800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:04.797717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:04.811648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69950be-dce8-422b-a1d4-c1b7dc85872a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:04.820642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:04.821431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.821808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.822180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.823771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:04.826017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.843699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.853437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 649/1320] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:04.861463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b133-edee-4d20-8644-11d3e286734b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:04.868043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:04.868905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:04.869269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:04.869642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] PATH_INFO: `/v3/projects/8f2159e350724e4c857993f83d2b90ea/users/f6564640554e44c5868371fbd83029d4/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:04.894271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2159e350724e4c857993f83d2b90ea, user_id=f6564640554e44c5868371fbd83029d4, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:04.899703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:04.930770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 672/1321] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:04 2022] PUT /identity/v3/projects/8f2159e350724e4c857993f83d2b90ea/users/f6564640554e44c5868371fbd83029d4/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:04.935100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:04.952990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c1ce-7996-486e-b3fe-c7218617f093 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:05.119433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:05.121430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:05.123215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:05.124283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:05.126000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:05.130791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:05.151106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 650/1322] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:08:05.155555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:05.172004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68afc7-4a73-4da2-9413-ebfbfc7c6486 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:05.180312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:05.181225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:05.181767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:05.182316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] PATH_INFO: `/v3/projects/8f2159e350724e4c857993f83d2b90ea/users/f6564640554e44c5868371fbd83029d4/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:05.190408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2159e350724e4c857993f83d2b90ea, user_id=f6564640554e44c5868371fbd83029d4, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:05.194512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1204-fcb3-4cba-8d90-e67db6d5c2ea admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:05.213582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 673/1323] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:05 2022] PUT /identity/v3/projects/8f2159e350724e4c857993f83d2b90ea/users/f6564640554e44c5868371fbd83029d4/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:05.341214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:05.343041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:05.361013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5653872-1236-4a1c-8847-589932e29eb6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:05.473624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:05.475822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:05.476184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:05.476527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] PATH_INFO: `/v3/users/5a0c89cb1e5349f681fc74f191ad9725` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:05.478433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0c89cb1e5349f681fc74f191ad9725)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:05.482158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:05.568031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0c89cb1e5349f681fc74f191ad9725'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:05.577343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0c89cb1e5349f681fc74f191ad9725'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:05.590896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0c89cb1e5349f681fc74f191ad9725'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:05.612118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0c89cb1e5349f681fc74f191ad9725'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:05.613826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0c89cb1e5349f681fc74f191ad9725'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:05.648523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 651/1324] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:05 2022] DELETE /identity/v3/users/5a0c89cb1e5349f681fc74f191ad9725 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:05.653301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:05.653401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:05.653672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:05.732996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:05.740154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:05.869814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:05.908609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 674/1325] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:05.948268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:05.950419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:05.984996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:05.986216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:05.990097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:06.050957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed27d-6409-4d18-81e6-ae3716e45c54 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:06.064506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:06.068357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.070000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.073056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] PATH_INFO: `/v3/projects/10ff32e6a0264adeab76f1b88c9230ff` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.078346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ff32e6a0264adeab76f1b88c9230ff)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:06.079430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: WARNING py.warnings [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:08:06.079430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: warnings.warn(msg) Oct 23 00:08:06.079430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: Oct 23 00:08:06.080670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:06.198497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1762d-ed72-4655-9c45-4fe012d676f1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:06.270027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ff32e6a0264adeab76f1b88c9230ff', 'request_id': 'req-8d19a30a-9000-4aa2-a1c3-01f736aba78a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:06.295800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ff32e6a0264adeab76f1b88c9230ff', 'request_id': 'req-8d19a30a-9000-4aa2-a1c3-01f736aba78a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:06.363488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ff32e6a0264adeab76f1b88c9230ff', 'request_id': 'req-8d19a30a-9000-4aa2-a1c3-01f736aba78a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:06.408017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] The token cache is being invalidate because project 10ff32e6a0264adeab76f1b88c9230ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:06.424029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:06.428129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d19a30a-9000-4aa2-a1c3-01f736aba78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:06.440069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 675/1326] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:05 2022] DELETE /identity/v3/projects/10ff32e6a0264adeab76f1b88c9230ff => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:06.442746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.443230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.443347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.453060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:06.455925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.456738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.461158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.466872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:06.489271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:06.493484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:06.655759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:06.662367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc16fd-15df-4a22-81d4-8f42790bbe9b service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:06.699741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 652/1327] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:06.728867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 676/1328] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:06.741041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.741041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.741041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.796190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:06.797924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:06.827356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 653/1329] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:06.829335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:06.843922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd7e0c-dcda-4b29-a467-ee5b75af7cc6 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:06.856298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:06.856837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.857053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.857316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.858125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:06.858429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:06.868581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:06.905574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 677/1330] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:06.907216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:06.918204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f600-05e6-4cc5-8e9a-9e5065b61895 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:06.934647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:06.935016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:06.935322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:06.935602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:06.936286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:06.939535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.011709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 654/1331] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:06 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:07.014065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.029454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436729-2245-4945-ada5-0cadd41a1621 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:07.180105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:07.193483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:07.194708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.194832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.195141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.195797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:07.199494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.251483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 678/1332] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:07 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:07.255791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.269191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba3ec-4722-46d6-89e1-76232f8470e3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:07.274701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:07.276294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.277563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.277844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.278514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:07.280297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.294046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 655/1333] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:07.297932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.315241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125aaf-b946-44cc-864c-70375e7706b7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:07.329329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:07.330798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.332038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.333757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.334602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:07.338702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8069f-39c0-4fda-b001-b782ab596433 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.369742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 679/1334] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:07.374429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.391495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56079-0341-4ae0-b6f4-7d136b37453a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:07.402860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:07.407217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.407217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.407658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] PATH_INFO: `/v3/projects/aa867e0af018467783fdd839e0a070d2/users/bafba9375a9f4e6f80c920144e640d2f/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.476140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa867e0af018467783fdd839e0a070d2, user_id=bafba9375a9f4e6f80c920144e640d2f, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:07.478872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.511617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 656/1335] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:07 2022] PUT /identity/v3/projects/aa867e0af018467783fdd839e0a070d2/users/bafba9375a9f4e6f80c920144e640d2f/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:07.528069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.528069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.528567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.604259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] MFA Rules not processed for user `bafba9375a9f4e6f80c920144e640d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:07.605805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:07.733450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 680/1336] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:07.735107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.754398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:07.856937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d327cc-c158-445d-b9b8-1806bccd53a6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:07.867678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:07.868457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:07.868844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:07.869218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:07.870041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:07.873322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:07.938757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 657/1337] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:07 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:07.940143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:07.961741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308978ac-2bb5-4b29-bbcd-76ea2c3c915f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:08.141120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:08.142148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.142697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.143770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.146632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:08.150941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:08.193848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 681/1338] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:07 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:08.194042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:08.210180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3ef2-f01f-48ef-833d-7aebb708a190 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:08.242172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:08.242172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.242172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.242172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.242609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:08.243718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:08.268418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 658/1339] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:08.272870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:08.312052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7785e-245f-4538-b63f-af0436be6b5d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:08.325819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:08.326945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.327488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.328286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] PATH_INFO: `/v3/projects/2e59253c54f649b2887b9797a7efec7a/users/bbb9d7d5a58c42e996d25604f174b04c/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.352689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e59253c54f649b2887b9797a7efec7a, user_id=bbb9d7d5a58c42e996d25604f174b04c, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:08.355944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:08.383124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 682/1340] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:08 2022] PUT /identity/v3/projects/2e59253c54f649b2887b9797a7efec7a/users/bbb9d7d5a58c42e996d25604f174b04c/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:08.387044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:08.399592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c6dc-ad89-46eb-8ac8-a15533344d4f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:08.493332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:08.493993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.494276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.494552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.495238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:08.496878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4ed8-a1b8-4214-96f4-cb9a7245fbc6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:08.508386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 659/1341] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:08.512651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:08.546232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea87e47-8c48-4b0b-ab73-128b4cf08fcc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:08.556648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:08.557729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.558233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.559676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] PATH_INFO: `/v3/projects/2e59253c54f649b2887b9797a7efec7a/users/bbb9d7d5a58c42e996d25604f174b04c/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.561983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e59253c54f649b2887b9797a7efec7a, user_id=bbb9d7d5a58c42e996d25604f174b04c, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:08.564919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:08.580212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 683/1342] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:08 2022] PUT /identity/v3/projects/2e59253c54f649b2887b9797a7efec7a/users/bbb9d7d5a58c42e996d25604f174b04c/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:08.597315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:08.597523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:08.597738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:08.663147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] MFA Rules not processed for user `bbb9d7d5a58c42e996d25604f174b04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:08.665290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:08.825248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 660/1343] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:08.825897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:08.828123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:08.886324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:09.010279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526810d1-ffce-48c6-8687-2271c45c04c3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:09.018166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:09.023317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:09.023746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:09.024120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:09.060143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:09.064383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e66a-bfbe-4392-8d1d-fe91d9bff0cd service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:09.095444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 684/1344] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:09.172291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:09.191060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:09.431531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048cf98-888f-48d0-8708-5964f39c465d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:09.459406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:09.460450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:09.460935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:09.461595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] PATH_INFO: `/v3/users/bafba9375a9f4e6f80c920144e640d2f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:09.463033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafba9375a9f4e6f80c920144e640d2f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:09.465816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:09.585051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafba9375a9f4e6f80c920144e640d2f'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:09.605446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafba9375a9f4e6f80c920144e640d2f'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:09.620471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafba9375a9f4e6f80c920144e640d2f'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:09.655017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafba9375a9f4e6f80c920144e640d2f'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:09.656634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafba9375a9f4e6f80c920144e640d2f'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:09.671758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 661/1345] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:09 2022] DELETE /identity/v3/users/bafba9375a9f4e6f80c920144e640d2f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:09.676926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d40b7-1036-489c-9baf-61c38593786b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:09.677472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d40b7-1036-489c-9baf-61c38593786b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:09.677472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d40b7-1036-489c-9baf-61c38593786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:09.711666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7a1d40b7-1036-489c-9baf-61c38593786b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:09.713075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7a1d40b7-1036-489c-9baf-61c38593786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:09.869117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 685/1346] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:09.883189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:09.884934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:10.046917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af874ccc-c0f0-4049-aabe-aeec97748cda admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:10.055798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:10.056520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:10.056717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:10.056990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:10.082537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:10.084035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:10.107293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 662/1347] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:10.174175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:10.174765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:10.174917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:10.270415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] MFA Rules not processed for user `f6564640554e44c5868371fbd83029d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:10.271958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:10.509031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 686/1348] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:10.623628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:10.624800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:10.651233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe9ab-ce84-49e2-b816-fdbeaba9b865 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:10.676504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:10.677317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:10.677639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:10.677853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] PATH_INFO: `/v3/projects/b8569959517e4cfba16274cfc9685921` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:10.692011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8569959517e4cfba16274cfc9685921)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:10.694188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:10.789108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:10.869907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8569959517e4cfba16274cfc9685921', 'request_id': 'req-bb648bc5-eeb9-4cb3-a642-aeef053a812e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:10.886985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8569959517e4cfba16274cfc9685921', 'request_id': 'req-bb648bc5-eeb9-4cb3-a642-aeef053a812e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:10.898934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8569959517e4cfba16274cfc9685921', 'request_id': 'req-bb648bc5-eeb9-4cb3-a642-aeef053a812e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:10.927672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] The token cache is being invalidate because project b8569959517e4cfba16274cfc9685921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:10.927823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:10.933418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:10.941358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 663/1349] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:10 2022] DELETE /identity/v3/projects/b8569959517e4cfba16274cfc9685921 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:10.942265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:10.961593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4db52-b993-4234-8354-a7c03b25f997 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:11.090200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:11.124840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:11.125683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:11.126073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:11.126458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] PATH_INFO: `/v3/users/e5893141eb3f414abdb4e684a6a7db79` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:11.128601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5893141eb3f414abdb4e684a6a7db79)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:11.133396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:11.248082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5893141eb3f414abdb4e684a6a7db79'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:11.252082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5893141eb3f414abdb4e684a6a7db79'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:11.268618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5893141eb3f414abdb4e684a6a7db79'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:11.297995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5893141eb3f414abdb4e684a6a7db79'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:11.320783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5893141eb3f414abdb4e684a6a7db79'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:11.336396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 687/1350] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:10 2022] DELETE /identity/v3/users/e5893141eb3f414abdb4e684a6a7db79 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:12.068088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:12.069577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:12.112262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648bc5-eeb9-4cb3-a642-aeef053a812e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:12.247754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:12.248436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:12.248721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:12.252178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] PATH_INFO: `/v3/projects/aa867e0af018467783fdd839e0a070d2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:12.253791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa867e0af018467783fdd839e0a070d2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:12.256218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:12.390150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa867e0af018467783fdd839e0a070d2', 'request_id': 'req-c90203ea-543c-4fd8-a444-87bd6d4f8700'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.403722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa867e0af018467783fdd839e0a070d2', 'request_id': 'req-c90203ea-543c-4fd8-a444-87bd6d4f8700'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.412582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa867e0af018467783fdd839e0a070d2', 'request_id': 'req-c90203ea-543c-4fd8-a444-87bd6d4f8700'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.448444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] The token cache is being invalidate because project aa867e0af018467783fdd839e0a070d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:12.448889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.449701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c90203ea-543c-4fd8-a444-87bd6d4f8700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.451679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 664/1351] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:12 2022] DELETE /identity/v3/projects/aa867e0af018467783fdd839e0a070d2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:12.455550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:12.458528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:12.487470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ba4b-3357-415f-9c93-48b902f28857 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:12.645322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:12.646023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:12.646300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:12.646575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] PATH_INFO: `/v3/users/bbb9d7d5a58c42e996d25604f174b04c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:12.651637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb9d7d5a58c42e996d25604f174b04c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:12.656904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:12.766682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb9d7d5a58c42e996d25604f174b04c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.766999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb9d7d5a58c42e996d25604f174b04c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.789826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb9d7d5a58c42e996d25604f174b04c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.814539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:12.833340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb9d7d5a58c42e996d25604f174b04c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.862703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-15cea946-556a-4ffd-adcf-c9bbf0f45f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb9d7d5a58c42e996d25604f174b04c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:12.882078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 688/1352] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:12 2022] DELETE /identity/v3/users/bbb9d7d5a58c42e996d25604f174b04c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:12.914142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:12.915110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:12.915661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:12.918672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 665/1353] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:08:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:12.931615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823325-05ed-4535-b401-1bf8052dab40 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:12.931930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823325-05ed-4535-b401-1bf8052dab40 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:12.932507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42823325-05ed-4535-b401-1bf8052dab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:12.980284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-42823325-05ed-4535-b401-1bf8052dab40 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:12.983385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-42823325-05ed-4535-b401-1bf8052dab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:13.171892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 689/1354] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:08:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:13.299771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:13.301473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:13.351328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a684c0-defc-4889-85b0-c58a605005e8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:13.364546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:13.365374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:13.365768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:13.366221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:13.386060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:13.390874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fa7eb-8028-4d0c-8394-e2ede24d5705 service placement] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:13.434905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 666/1355] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:13.756058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a382af-84fd-45cb-b17b-30151d1c9953 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:13.756540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a382af-84fd-45cb-b17b-30151d1c9953 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:13.756661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a382af-84fd-45cb-b17b-30151d1c9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:13.791963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b3a382af-84fd-45cb-b17b-30151d1c9953 None None] MFA Rules not processed for user `e9794dc24e24452294f5e04d0fba042e`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:13.793418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b3a382af-84fd-45cb-b17b-30151d1c9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:13.929444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 690/1356] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:13.940307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cceb-45ed-4dfb-92ed-ee1271d61c47 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:13.941938 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cceb-45ed-4dfb-92ed-ee1271d61c47 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:13.942604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cceb-45ed-4dfb-92ed-ee1271d61c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:13.977199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2524cceb-45ed-4dfb-92ed-ee1271d61c47 None None] MFA Rules not processed for user `e9794dc24e24452294f5e04d0fba042e`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:13.978586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2524cceb-45ed-4dfb-92ed-ee1271d61c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:13.987959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 667/1357] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:14.022940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda6e6-9c40-4252-837e-9d18a54f5974 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:14.023282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda6e6-9c40-4252-837e-9d18a54f5974 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:14.023548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadda6e6-9c40-4252-837e-9d18a54f5974 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:14.028533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 691/1358] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:08:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:14.039211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c17512-0389-4809-ad12-a380de358364 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:14.039439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c17512-0389-4809-ad12-a380de358364 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:14.039712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c17512-0389-4809-ad12-a380de358364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:14.123117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-d8c17512-0389-4809-ad12-a380de358364 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:14.128693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:14.130089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d8c17512-0389-4809-ad12-a380de358364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:14.249615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 668/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:08:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:14.250599 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadda6e6-9c40-4252-837e-9d18a54f5974 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:14.310761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c17512-0389-4809-ad12-a380de358364 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:14.316459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadda6e6-9c40-4252-837e-9d18a54f5974 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:14.319476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d8c17512-0389-4809-ad12-a380de358364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:14.345746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:14.346379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:14.346689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:14.347027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:14.367611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:14.369095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d4b8-9bcc-4dc1-a02c-b2ef71a0c4a2 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:14.411016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 692/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:14.569837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c17512-0389-4809-ad12-a380de358364 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:14.587490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:14.588312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:14.588699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:14.589102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] PATH_INFO: `/v3/projects/5d40b23db8b34919b4a0451433d6923c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:14.591299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d40b23db8b34919b4a0451433d6923c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:14.593612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:14.744029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d40b23db8b34919b4a0451433d6923c', 'request_id': 'req-4cc37ac3-6ecf-470b-83b2-b220a135a283'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:14.760474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d40b23db8b34919b4a0451433d6923c', 'request_id': 'req-4cc37ac3-6ecf-470b-83b2-b220a135a283'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:14.767387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d40b23db8b34919b4a0451433d6923c', 'request_id': 'req-4cc37ac3-6ecf-470b-83b2-b220a135a283'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:14.818037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] The token cache is being invalidate because project 5d40b23db8b34919b4a0451433d6923c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:14.818437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:14.819029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4cc37ac3-6ecf-470b-83b2-b220a135a283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:14.823090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 669/1361] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:14 2022] DELETE /identity/v3/projects/5d40b23db8b34919b4a0451433d6923c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:14.830393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:14.830393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:14.831034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:14.873992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:14.875309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:14.995852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:15.024571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 693/1362] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:15.031384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.031674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.031945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.071410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:15.073144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:15.091042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 670/1363] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:15.095370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.105945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d02f36-a26f-47aa-a7c1-2b565dc4247c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.125416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.126562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.126991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.127430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.128784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:15.129243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.132833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9116f64-025a-4ea2-9fae-e559333ff1bc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.165294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 694/1364] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:15.170285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.185399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f84ad-768f-41f2-a556-d0c818289fe4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.193921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.194157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.199337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.199628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.203878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.210600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.215366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e0422-7301-4c65-bb52-2d1b02266d6b None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.215650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e0422-7301-4c65-bb52-2d1b02266d6b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.216112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e0422-7301-4c65-bb52-2d1b02266d6b None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.217641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 695/1365] 10.222.0.20 () {54 vars in 912 bytes} [Sun Oct 23 00:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:08:15.223795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505e07-5e96-499a-b444-563088238f91 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.224302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505e07-5e96-499a-b444-563088238f91 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.224751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505e07-5e96-499a-b444-563088238f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.272453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4f505e07-5e96-499a-b444-563088238f91 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:15.279249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4f505e07-5e96-499a-b444-563088238f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:15.289793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:15.305715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 671/1366] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:15 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:15.310552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.442171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 696/1367] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:08:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:15.451161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac14f0-a726-44d7-889a-01329b0487e0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.456502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.457244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.457627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.458094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.459935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f505e07-5e96-499a-b444-563088238f91 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.461580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4f505e07-5e96-499a-b444-563088238f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:15.471412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.471412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.530107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 672/1368] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:15 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:08:15.532275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.552070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f3f8-8bf6-4f16-a3e5-6d5f8646ea01 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.557049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.557773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.558279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.558652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.559711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.577831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.607148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 673/1369] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:15.610919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.637685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2017b17-0ab7-4acb-ac26-df6bb68a0b96 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.653959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.654599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.654874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.655178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.655834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.658153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.672346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f505e07-5e96-499a-b444-563088238f91 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.684399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 674/1370] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:15.689175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:15.711244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dca94-3ee6-4b7d-9b3f-b0e39c429097 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:15.727645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.728271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.728845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.728845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] PATH_INFO: `/v3/projects/93c48396add34e20b9304819ac739a3b/users/06653c8ce1e641138dded8784084c906/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.765475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c48396add34e20b9304819ac739a3b, user_id=06653c8ce1e641138dded8784084c906, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:15.770917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680e4e7-ae7e-4a15-99f9-dc5e73894be5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:15.801676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 675/1371] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:15 2022] PUT /identity/v3/projects/93c48396add34e20b9304819ac739a3b/users/06653c8ce1e641138dded8784084c906/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:15.817223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.817521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.817794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.829353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:15.830000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:15.830284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:15.830561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:15.896146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] MFA Rules not processed for user `06653c8ce1e641138dded8784084c906`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:15.900836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:15.906890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:16.056570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.058056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.100282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 697/1372] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:16.101320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.106622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:16.114712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 676/1373] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:16.116303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.175442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d791da-a570-42b9-9aa5-594a1a2cdf03 service glance] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:16.204305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:16.269612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891272a7-c907-4c2c-9f94-7c9b7c05f8b3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:16.275596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:16.276444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.276931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.277305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.278441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.282083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.319399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:16.320183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.320627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.321001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] PATH_INFO: `/v3/projects/2e59253c54f649b2887b9797a7efec7a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.323584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e59253c54f649b2887b9797a7efec7a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.325729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.348435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 677/1374] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:16 2022] POST /identity/v3/projects => generated 401 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:08:16.348435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.354815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:16.447065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e59253c54f649b2887b9797a7efec7a', 'request_id': 'req-918b1bb5-a221-4435-8a2c-a71339d60201'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.465586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e59253c54f649b2887b9797a7efec7a', 'request_id': 'req-918b1bb5-a221-4435-8a2c-a71339d60201'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.484357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e59253c54f649b2887b9797a7efec7a', 'request_id': 'req-918b1bb5-a221-4435-8a2c-a71339d60201'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.519436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d0f2-c420-42b1-972a-b85522bf991c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:16.529770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] The token cache is being invalidate because project 2e59253c54f649b2887b9797a7efec7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:16.530526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.531628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.533868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 698/1375] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:16 2022] DELETE /identity/v3/projects/2e59253c54f649b2887b9797a7efec7a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:16.536008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.543419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:16.649604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:16.699737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:16.700491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.700808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.701203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] PATH_INFO: `/v3/users/4053765239cc4f98ac3513dd88c85693` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.703745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1bb5-a221-4435-8a2c-a71339d60201 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:16.717522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:16.718381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.718767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.719166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.719668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4053765239cc4f98ac3513dd88c85693)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.720093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.721850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.724235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea4865-19ac-464c-86b8-5b38e4c6e241 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.775024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 699/1376] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:16 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:16.781620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.782849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.783406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.826361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4053765239cc4f98ac3513dd88c85693'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.841336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:16.843230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4053765239cc4f98ac3513dd88c85693'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.856748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:16.859862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4053765239cc4f98ac3513dd88c85693'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.869892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:16.875278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 700/1377] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:16.877566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.906035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4053765239cc4f98ac3513dd88c85693'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.906815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-86517583-f954-4088-aedd-1bca3de34d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4053765239cc4f98ac3513dd88c85693'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:16.911732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0ad9-9fd3-4781-a602-9929c9c89dee None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:16.920999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:16.921361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 678/1378] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:16 2022] DELETE /identity/v3/users/4053765239cc4f98ac3513dd88c85693 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:16.922339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.922723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:16.923559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.938003 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.939310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:16.941927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:16.944900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:16.954049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:16.970643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 701/1379] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:16.977649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:16.979914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:16.999631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ccdaf-6dc9-4e37-8767-ded8e6a12071 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.022919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:17.025561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:17.138127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.139099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.139537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.139989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] PATH_INFO: `/v3/projects/05f5324e9dac4e3a837631ed209e9dc3/users/e0279e8ae77e49dea5bd6fb5f2314ae5/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.161737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 679/1380] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:17.164042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.175020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f5324e9dac4e3a837631ed209e9dc3, user_id=e0279e8ae77e49dea5bd6fb5f2314ae5, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.177766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.180286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d586e1-d7d7-408c-a466-96269a23b16f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.191016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.191325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.191646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.193344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.194145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:17.194460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.198843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.200430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 702/1381] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:16 2022] PUT /identity/v3/projects/05f5324e9dac4e3a837631ed209e9dc3/users/e0279e8ae77e49dea5bd6fb5f2314ae5/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:17.204579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.232302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 680/1382] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:17.247365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.286088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9257-e0a8-4ef4-a655-59e361ad0abc admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.366708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d1b2-f5b7-4306-a964-42e4fcd4699c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.373203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.374393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.374971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.375287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.375949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.378901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.393266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 703/1383] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:17.393266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.399184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:17.430834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b843-7050-4adc-879d-20f4085b1efc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.433749 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.434388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.434666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.435098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.435602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.440865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c438bba-0a37-4318-948f-52d7c7f976c2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.445256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.446463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.447438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.447930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] PATH_INFO: `/v3/projects/abf73f3d9fc74a9fa2c47127b948b3ea` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.451526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf73f3d9fc74a9fa2c47127b948b3ea)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.455223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.484206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 681/1384] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:17 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:17.486736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.486736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.486988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.531548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:17.548527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] MFA Rules not processed for user `5ba37660a05e44f5a7f10946e79cb250`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:17.549953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:17.578595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf73f3d9fc74a9fa2c47127b948b3ea', 'request_id': 'req-fbf29cd6-dff1-414b-85ff-f349f927876c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:17.595858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf73f3d9fc74a9fa2c47127b948b3ea', 'request_id': 'req-fbf29cd6-dff1-414b-85ff-f349f927876c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:17.609484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf73f3d9fc74a9fa2c47127b948b3ea', 'request_id': 'req-fbf29cd6-dff1-414b-85ff-f349f927876c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:17.612652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:17.634578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] The token cache is being invalidate because project abf73f3d9fc74a9fa2c47127b948b3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:17.635056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:17.636100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:17.637732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 704/1385] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:17 2022] DELETE /identity/v3/projects/abf73f3d9fc74a9fa2c47127b948b3ea => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:17.640706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.644367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:17.658858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 682/1386] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:17.660464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.742741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf29cd6-dff1-414b-85ff-f349f927876c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.749980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.751865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.752266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.752812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] PATH_INFO: `/v3/projects/05f5324e9dac4e3a837631ed209e9dc3/users/e0279e8ae77e49dea5bd6fb5f2314ae5/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.755639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f5324e9dac4e3a837631ed209e9dc3, user_id=e0279e8ae77e49dea5bd6fb5f2314ae5, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.758779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.763809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc287-a3b3-4ea1-895c-4d3fa73e98ac None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.771691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 705/1387] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:17 2022] PUT /identity/v3/projects/05f5324e9dac4e3a837631ed209e9dc3/users/e0279e8ae77e49dea5bd6fb5f2314ae5/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:17.772820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:17.789179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:17.856593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.857616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.858466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.858954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.859997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.862792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ad3f-c035-4146-82b0-481cc4f41ee4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.898811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 683/1388] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:17 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:17.901360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503712-d0c8-405b-8304-8d9e07fffcba None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.901957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503712-d0c8-405b-8304-8d9e07fffcba None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.902506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503712-d0c8-405b-8304-8d9e07fffcba None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.905592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 684/1389] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:08:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:17.907212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0539b-a8ec-4d3d-a199-25205cc6359c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.907719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0539b-a8ec-4d3d-a199-25205cc6359c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.908529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0539b-a8ec-4d3d-a199-25205cc6359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.937793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6716a3d-cc06-48ca-9a0f-3cc17a402ce1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:17.937793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:17.937793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:17.937793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:17.944136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] PATH_INFO: `/v3/users/f6564640554e44c5868371fbd83029d4` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:17.944136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6564640554e44c5868371fbd83029d4)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:17.945217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:17.975590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-58d0539b-a8ec-4d3d-a199-25205cc6359c None None] MFA Rules not processed for user `e0279e8ae77e49dea5bd6fb5f2314ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:17.977063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-58d0539b-a8ec-4d3d-a199-25205cc6359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.058524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6564640554e44c5868371fbd83029d4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.061395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6564640554e44c5868371fbd83029d4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.072660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:18.082568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6564640554e44c5868371fbd83029d4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.120254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6564640554e44c5868371fbd83029d4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.141489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 685/1390] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:17 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:18.153017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8d156f9f-b3db-4c88-ba79-ab68f1d92bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6564640554e44c5868371fbd83029d4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.155976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.157283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.157592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.162800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 686/1391] 10.222.0.20 () {54 vars in 912 bytes} [Sun Oct 23 00:08:18 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:18.164085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.167902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.169450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 706/1392] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:17 2022] DELETE /identity/v3/users/f6564640554e44c5868371fbd83029d4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:18.171435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf651-b7c8-4c20-830a-a544c29e4195 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.171736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf651-b7c8-4c20-830a-a544c29e4195 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.172019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf651-b7c8-4c20-830a-a544c29e4195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.191728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:18.213088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9aadf651-b7c8-4c20-830a-a544c29e4195 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:18.214323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9aadf651-b7c8-4c20-830a-a544c29e4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.316440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dad81-5a29-4ec1-b6b9-1645342d1c11 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:18.331901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:18.333816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.334109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.334388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.335058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:18.336873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:18.358122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 687/1393] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:18.363012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.369542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.372525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 707/1394] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:08:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:18.373820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.374386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.374670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.466551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:18.468022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.501961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef1fe-7991-41f6-b4a4-899e63910c67 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:18.507056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:18.507945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.508391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.509035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.511031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.593726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 708/1395] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:08:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:18.595790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.624496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223428dc-f804-4226-abe2-3e1f79706208 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:18.648763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:18.650327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:18.653474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:18.654238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.654601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.654947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.655710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:18.660484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:18.687456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 688/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:18 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:18.688316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.706217 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 709/1397] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:18.714296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.726264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.730819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e235-d8d2-4f21-8198-3c958b9ee66a service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:18.753509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:18.754550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.755289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.755831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.758311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.768662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3641e-3839-4055-851f-e10ab2a39644 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:18.800358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:18.801228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:18.801575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:18.801990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] PATH_INFO: `/v3/projects/8f2159e350724e4c857993f83d2b90ea` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:18.804395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2159e350724e4c857993f83d2b90ea)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:18.814353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:18.910736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:18.912399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:18.921253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:18.923215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:18.936248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 689/1398] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:18.936410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2159e350724e4c857993f83d2b90ea', 'request_id': 'req-8e56f303-fe0b-4f8d-841f-0f591ca39e03'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.950722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:18.952606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:18.953186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2159e350724e4c857993f83d2b90ea', 'request_id': 'req-8e56f303-fe0b-4f8d-841f-0f591ca39e03'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.972159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2159e350724e4c857993f83d2b90ea', 'request_id': 'req-8e56f303-fe0b-4f8d-841f-0f591ca39e03'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:18.980832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a051-0df7-44f4-9efa-447dda91a43f service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.002988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] The token cache is being invalidate because project 8f2159e350724e4c857993f83d2b90ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:19.003313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:19.005818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:19.008404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 710/1399] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:18 2022] DELETE /identity/v3/projects/8f2159e350724e4c857993f83d2b90ea => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:19.009405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.021606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.095760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.096404 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.096713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.096990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.098837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.119046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.120619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.139466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f303-fe0b-4f8d-841f-0f591ca39e03 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.141206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 690/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:19.142089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.144037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.151688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.152731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.153276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.153859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] PATH_INFO: `/v3/projects/c9b044c96f954320833bd9df3c6189dd/users/a2d31cc7db1b4b09a7ecbf81b4c6ac1f/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.188929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b044c96f954320833bd9df3c6189dd, user_id=a2d31cc7db1b4b09a7ecbf81b4c6ac1f, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.193098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa033e-827a-429a-8c0c-17f0cb10d26b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.249243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 711/1401] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:19 2022] PUT /identity/v3/projects/c9b044c96f954320833bd9df3c6189dd/users/a2d31cc7db1b4b09a7ecbf81b4c6ac1f/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:19.250710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05294-6423-4dfa-9403-9946dc929d82 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.253716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05294-6423-4dfa-9403-9946dc929d82 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.254110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05294-6423-4dfa-9403-9946dc929d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.277628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a2cbf-8016-4b36-824c-6799a8f193de service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.317826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f9f05294-6423-4dfa-9403-9946dc929d82 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:19.319577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f9f05294-6423-4dfa-9403-9946dc929d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.384856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.385731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.386155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.386572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.390961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.511148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 712/1402] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:19.511148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.511148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.511148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.526203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.534953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328a03-1666-4621-9888-cb36ee497c9d service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.553626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 691/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:19.556301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.559599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.560653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.570493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] MFA Rules not processed for user `a2d31cc7db1b4b09a7ecbf81b4c6ac1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:19.573403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.590839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:19.605636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:19.609618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:19.631540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 692/1404] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:19.636734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.657166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476ba4e-dad1-4858-8883-b1e7509e02a0 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.672883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.674433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.674890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.675289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.676979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:19.678273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.680355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:19.682578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.723045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 693/1405] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:19.724398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.749603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 713/1406] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:19.750837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7ea4-57bf-42f5-a252-b667fc0e1c69 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.754354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.775385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.777626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.777924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.778212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.779892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.782218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.786045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b060b-326d-42c8-8474-c991b63005e4 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:19.801730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:19.802674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:19.803728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:19.804274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:19.807558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:19.817575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:19.897610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 694/1407] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:19.902668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:19.926492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 714/1408] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:19.928274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.125869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17172-4522-4f8e-8afe-2a85af006a6c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.150958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.152619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd1a6c-7f03-4bd3-a7cb-560d64456e2a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.154217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.154503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.156202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.156934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.170901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.173169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.173539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.175551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.176241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.178294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.187233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.255465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 715/1409] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:20.255626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 695/1410] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:19 2022] POST /identity/v3/users => generated 286 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:20.258777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.269667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.285782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06936600-720a-4b40-998d-5248abc4deb7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.302561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.303282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.303566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.303840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.304517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.306505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e93fcb-7605-4afb-9e11-a6fa9b52efb2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.306615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.321906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.322551 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.322841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.323430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.323792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.325401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.342331 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 716/1411] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:20.348289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.376968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfff78-4ce1-4054-8b73-b020627ed615 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.382995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 696/1412] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:20.387471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.392337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.392974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.393308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.393597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.399483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.404544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.419185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da58ed-ca62-4fcc-a7a1-9c019e7a886a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.439283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 717/1413] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:20.441586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.443206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.445192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.445632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.446113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] PATH_INFO: `/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93/users/72e958ab99a94573a47bd5565c4fcb8b/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.466642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b4c5a-c9c9-448c-ae6d-93a8537f6169 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.480046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.481360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.484435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.485466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] PATH_INFO: `/v3/projects/3f3c9bf0f5464419a57be8ea9fcfe91a/users/2758f46b62c0493c9a0edaed3a7c6ace/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.501364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17dc8bd5f0a4cb196fa3fd924027c93, user_id=72e958ab99a94573a47bd5565c4fcb8b, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.514914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.544305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3c9bf0f5464419a57be8ea9fcfe91a, user_id=2758f46b62c0493c9a0edaed3a7c6ace, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.551258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f70575-326c-4836-8aae-df9832d01956 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.557508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 697/1414] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:20 2022] PUT /identity/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93/users/72e958ab99a94573a47bd5565c4fcb8b/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:20.558615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.593007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 718/1415] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:20 2022] PUT /identity/v3/projects/3f3c9bf0f5464419a57be8ea9fcfe91a/users/2758f46b62c0493c9a0edaed3a7c6ace/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:20.594737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.595428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.595713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.712861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] MFA Rules not processed for user `2758f46b62c0493c9a0edaed3a7c6ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:20.716846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:20.778169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be552a-9056-462f-953c-a6f690a7c3fd admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.856852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:20.917073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:20.918064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.918455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.918841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.920086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:20.922257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4ef7c-9c26-4968-a456-53db4f545bc0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:20.926788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:20.946307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 698/1416] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:20.948034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9660-4da2-4315-85af-17d321dfc066 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:20.948596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9660-4da2-4315-85af-17d321dfc066 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:20.949030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a9660-4da2-4315-85af-17d321dfc066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:20.968717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 719/1417] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:20.969666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:20.988946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-290a9660-4da2-4315-85af-17d321dfc066 None None] MFA Rules not processed for user `a8eddc1a05c14b26acaf7997784f9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:20.990229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca52f-9551-4869-9e5f-8147769091e8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:20.990772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-290a9660-4da2-4315-85af-17d321dfc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.004094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:21.004790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.005073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.005357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] PATH_INFO: `/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93/users/72e958ab99a94573a47bd5565c4fcb8b/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.011852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17dc8bd5f0a4cb196fa3fd924027c93, user_id=72e958ab99a94573a47bd5565c4fcb8b, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:21.022945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:21.047872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 720/1418] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:20 2022] PUT /identity/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93/users/72e958ab99a94573a47bd5565c4fcb8b/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:21.049028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:21.201504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 699/1419] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:21.205309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f3b5-d4ee-4d90-a3d9-9abeac94d98f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.207310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f3b5-d4ee-4d90-a3d9-9abeac94d98f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.208670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f3b5-d4ee-4d90-a3d9-9abeac94d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.225069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba14e9-0a71-4ab6-9600-cbb9a46b24d4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:21.248975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:21.249426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.249714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.249985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.250651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:21.253607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0c319-3161-4b75-9c48-588906523771 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:21.276771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-70a1f3b5-d4ee-4d90-a3d9-9abeac94d98f None None] MFA Rules not processed for user `72e958ab99a94573a47bd5565c4fcb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:21.278826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-70a1f3b5-d4ee-4d90-a3d9-9abeac94d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.304110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 721/1420] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:21.305412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.305725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.305988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.340808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] MFA Rules not processed for user `a8eddc1a05c14b26acaf7997784f9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:21.345865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.405206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 700/1421] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:21.406509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.406804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.407084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.418406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 701/1422] 10.222.0.20 () {54 vars in 912 bytes} [Sun Oct 23 00:08:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:21.426733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:21.432474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.504936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 722/1423] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:21.505539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:21.552528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:21.633099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930685-63d3-401d-b4e4-c943ca53848c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:21.643375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:21.644012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.644309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.644568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.646630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.665132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:21.667619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:21.681957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 702/1424] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:21.682128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:21.683591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.692256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1385-d56a-433a-9604-495ca8f3a90b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:21.703300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:21.704159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.704613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.707448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.708735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:21.710841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c0c1f-57f5-4225-9e89-7317b5833ff3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:21.768184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:21.783275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 723/1425] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:21 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:21.785332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.785618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.785898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.791009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981c61-a46d-4d25-bea9-ac28435aa4a1 service placement] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:21.802885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:21.803759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:21.804051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:21.804324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:21.855580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:21.858225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:21.978742 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:21.982052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:22.011585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 703/1426] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:22.012644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:22.017226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:22.130344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 724/1427] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:08:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:22.140157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:22.178520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ebb45-32b9-4325-aa81-5980fde32a05 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:22.202261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:22.203471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.203471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.203471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.204121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:22.206273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f024e-aebf-418a-9abe-d1be7e4d686c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:22.246774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 725/1428] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:22.247923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.248214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.248494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.291724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827566c2-18a9-4d0b-80b2-84b8a794ac1b service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:22.322170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:22.322760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.323043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.323408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.368886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:22.370445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:22.407255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] MFA Rules not processed for user `a925c18e67894c06863e68b2793488d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:22.408514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:22.423633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 704/1429] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:22.441208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:22.457902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:22.519575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4abb-0915-4811-89c9-ad63332d7397 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:22.537281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:22.538017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.538301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.538594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] PATH_INFO: `/v3/projects/b24a79dd1b494561a66c4f0c5efd8776/users/a969507f6b0c485b975e39fdcabaa768/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.620667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a79dd1b494561a66c4f0c5efd8776, user_id=a969507f6b0c485b975e39fdcabaa768, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:22.623012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:22.650860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 705/1430] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:22 2022] PUT /identity/v3/projects/b24a79dd1b494561a66c4f0c5efd8776/users/a969507f6b0c485b975e39fdcabaa768/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:22.651897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:22.673497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:22.720500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 726/1431] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:22.722229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:22.777256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1aba1-1422-43f0-aa3a-f8d807332226 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:22.864950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f14-e8f5-4ae3-b4af-2313bafec7de admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:22.870745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:22.871580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.871921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.872273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.962075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:22.964831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:22.965156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:22.965436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:22.966110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:22.974306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df455d-2bc5-4392-8451-d0084af72107 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:23.009418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 727/1432] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:23.013039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.015114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.016414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.043243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:23.044862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:23.058166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:23.074272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] MFA Rules not processed for user `5ba37660a05e44f5a7f10946e79cb250`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:23.074661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 706/1433] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:23.075601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:23.075732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:23.101157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c1cb-fa65-44e8-a7a1-07fb9c989e3f service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:23.117940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:23.118659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.118937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.119255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] PATH_INFO: `/v3/projects/b24a79dd1b494561a66c4f0c5efd8776/users/a969507f6b0c485b975e39fdcabaa768/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.122368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a79dd1b494561a66c4f0c5efd8776, user_id=a969507f6b0c485b975e39fdcabaa768, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:23.125306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee482b6-6b6d-4b38-b42f-f8e17f5a6a6d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:23.164366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 707/1434] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:23 2022] PUT /identity/v3/projects/b24a79dd1b494561a66c4f0c5efd8776/users/a969507f6b0c485b975e39fdcabaa768/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:23.168459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae9cc-d82c-416a-a052-47f807836be7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.168747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae9cc-d82c-416a-a052-47f807836be7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.169031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ae9cc-d82c-416a-a052-47f807836be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.232403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 728/1435] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:23.234400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:23.239287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1e1ae9cc-d82c-416a-a052-47f807836be7 None None] MFA Rules not processed for user `a969507f6b0c485b975e39fdcabaa768`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:23.240536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1e1ae9cc-d82c-416a-a052-47f807836be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:23.264179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d532ef0-5b3d-4505-9d94-ba1a840adc36 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:23.405609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:23.464959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:23.468331 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.468613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.468891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] PATH_INFO: `/v3/users/a2d31cc7db1b4b09a7ecbf81b4c6ac1f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.471401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d31cc7db1b4b09a7ecbf81b4c6ac1f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:23.482328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:23.497244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 708/1436] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:23.501618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc412-193f-4892-898e-407c0b9934ba None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.501618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc412-193f-4892-898e-407c0b9934ba None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.501967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc412-193f-4892-898e-407c0b9934ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.560915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-007bc412-193f-4892-898e-407c0b9934ba None None] MFA Rules not processed for user `db8a7662772f4ac69378d3f33e5e6098`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:23.562377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-007bc412-193f-4892-898e-407c0b9934ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:23.604372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d31cc7db1b4b09a7ecbf81b4c6ac1f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:23.605583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d31cc7db1b4b09a7ecbf81b4c6ac1f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:23.623481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d31cc7db1b4b09a7ecbf81b4c6ac1f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:23.647775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d31cc7db1b4b09a7ecbf81b4c6ac1f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:23.668024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d31cc7db1b4b09a7ecbf81b4c6ac1f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:23.686104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 729/1437] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:23 2022] DELETE /identity/v3/users/a2d31cc7db1b4b09a7ecbf81b4c6ac1f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:23.687013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:23.693163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:23.707518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 709/1438] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:23.708405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc412-193f-4892-898e-407c0b9934ba None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:23.716499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-007bc412-193f-4892-898e-407c0b9934ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:23.800061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:23.892566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc412-193f-4892-898e-407c0b9934ba None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:23.963038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e12a-5aa4-457a-aa79-f81863292cbf admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:23.980572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:23.983822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:23.984112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:23.985262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:23.992314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.059514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:24.060761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.062743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.063112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.066944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.108446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:24.110876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba8a2b-3995-47a4-8a71-e159a1809023 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:24.124104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 730/1439] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:24.125597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.126046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.126330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.153033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:24.154524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.206716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:24.248838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:24.254240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:24.277377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 710/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:24.278468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:24.295689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6bd95-0e13-4f75-8b72-cbf2d2de4cd4 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:24.302560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:24.303931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.304430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.305100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.333427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 731/1441] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:24.383411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:24.385115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.457521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:24.460490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:24.489221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 711/1442] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:24.537341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:24.538849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.566030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ede76-0715-440d-80cd-34a5e0cab876 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:24.576434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ac07-a232-4d0b-b403-1dc7993c608f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:24.582950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:24.583892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.584203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.584620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.589811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:24.595913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:24.597962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.598436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.599734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.637825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:24.640474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f69b-f23c-4c87-8f0a-a90c8c18e372 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:24.672854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 732/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:24.796969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:24.798878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f86151-9ae3-49d9-8519-02b013be51a9 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:24.819963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 712/1444] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:24.923116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:24.923784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:24.924104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:24.983216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] MFA Rules not processed for user `a8eddc1a05c14b26acaf7997784f9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:24.985593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:25.032744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:25.178005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 733/1445] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:25.611469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66ae3-2801-43da-a947-78cd1f48c77e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:25.612734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66ae3-2801-43da-a947-78cd1f48c77e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:25.613235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66ae3-2801-43da-a947-78cd1f48c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:25.746166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a0d66ae3-2801-43da-a947-78cd1f48c77e None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:25.748873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a0d66ae3-2801-43da-a947-78cd1f48c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:25.926002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:25.928413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:25.956682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:25.960420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b3af-e7d4-45a3-8c32-b1ea699a4a5d None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:25.975668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:25.989470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:25.989837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:25.991042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] PATH_INFO: `/v3/users/06653c8ce1e641138dded8784084c906` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:25.992158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 713/1446] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:08:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:26.001788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06653c8ce1e641138dded8784084c906)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:26.007768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:26.121078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06653c8ce1e641138dded8784084c906'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:26.122146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06653c8ce1e641138dded8784084c906'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:26.143700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06653c8ce1e641138dded8784084c906'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:26.183132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06653c8ce1e641138dded8784084c906'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:26.193309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06653c8ce1e641138dded8784084c906'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:26.207438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 734/1447] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:25 2022] DELETE /identity/v3/users/06653c8ce1e641138dded8784084c906 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:26.212030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:26.212415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:26.212813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:26.260628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:26.261887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:26.317825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:26.319561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:26.514546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 714/1448] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:26.622102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d53d7-24d6-45fa-b012-6542f7d5e419 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:26.633965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:26.635448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:26.644737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:26.646821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:26.647233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:26.648556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:26.650909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:26.711658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:26.816953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d6bd8-1ff8-4c3f-b927-5179e21d11f1 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:26.822937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:26.827729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:26.828035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:26.829016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:26.861560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:26.865573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d0693-b0ab-47a1-aca9-d31435cd9bc5 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:26.896256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:26.898289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:26.909180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 715/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:26.954956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 735/1450] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:08:27.849096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:27.850161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:27.850672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:27.923815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:27.928736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:27.976973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 716/1451] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:08:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:28.161038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:28.188866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816541a-81e9-431b-93c2-381312b4a26f service swift] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:28.202491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:28.207220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:28.207735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:28.208646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:28.233708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:28.237394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:28.265787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 736/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:28.435975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:28.438940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:28.462368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42b110-7d44-491c-aec0-4a56741254bf None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:28.470497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:28.472234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:28.472688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:28.473170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] PATH_INFO: `/v3/projects/c9b044c96f954320833bd9df3c6189dd` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:28.474729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b044c96f954320833bd9df3c6189dd)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:28.477648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:28.634504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b044c96f954320833bd9df3c6189dd', 'request_id': 'req-80a31355-a603-400f-964e-82d9cf242874'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:28.678612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b044c96f954320833bd9df3c6189dd', 'request_id': 'req-80a31355-a603-400f-964e-82d9cf242874'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:28.701719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b044c96f954320833bd9df3c6189dd', 'request_id': 'req-80a31355-a603-400f-964e-82d9cf242874'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:28.754204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] The token cache is being invalidate because project c9b044c96f954320833bd9df3c6189dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:28.756119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:28.758496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:28.765421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 717/1453] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:28 2022] DELETE /identity/v3/projects/c9b044c96f954320833bd9df3c6189dd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:28.770124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:28.798771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a049-e2bb-464d-a1a9-ce4d9a3b8495 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:29.008071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:29.008698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:29.008978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:29.009254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] PATH_INFO: `/v3/users/72e958ab99a94573a47bd5565c4fcb8b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:29.024025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e958ab99a94573a47bd5565c4fcb8b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:29.026520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:29.223302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e958ab99a94573a47bd5565c4fcb8b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:29.226327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e958ab99a94573a47bd5565c4fcb8b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:29.251540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e958ab99a94573a47bd5565c4fcb8b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:29.303539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e958ab99a94573a47bd5565c4fcb8b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:29.332644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e958ab99a94573a47bd5565c4fcb8b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:29.346778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 737/1454] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:28 2022] DELETE /identity/v3/users/72e958ab99a94573a47bd5565c4fcb8b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:29.476697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:29.478819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:29.530314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31355-a603-400f-964e-82d9cf242874 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:29.610916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:29.743550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:29.751767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:29.752141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:29.754338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] PATH_INFO: `/v3/projects/93c48396add34e20b9304819ac739a3b` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:29.760640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c48396add34e20b9304819ac739a3b)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:29.774776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:29.998566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c48396add34e20b9304819ac739a3b', 'request_id': 'req-b9ed7828-910e-442d-8260-959c7d6cfaf0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.031754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c48396add34e20b9304819ac739a3b', 'request_id': 'req-b9ed7828-910e-442d-8260-959c7d6cfaf0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.051442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c48396add34e20b9304819ac739a3b', 'request_id': 'req-b9ed7828-910e-442d-8260-959c7d6cfaf0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.094360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] The token cache is being invalidate because project 93c48396add34e20b9304819ac739a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:30.094657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.097355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.102932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 718/1455] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:29 2022] DELETE /identity/v3/projects/93c48396add34e20b9304819ac739a3b => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:30.106695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:30.108409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:30.130339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a08fc-d6cc-4596-ab8a-109a6f9236fe admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:30.151946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:30.290050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:30.293451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:30.295291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:30.296760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] PATH_INFO: `/v3/users/e0279e8ae77e49dea5bd6fb5f2314ae5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:30.299037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0279e8ae77e49dea5bd6fb5f2314ae5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:30.307648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:30.455832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0279e8ae77e49dea5bd6fb5f2314ae5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.459465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0279e8ae77e49dea5bd6fb5f2314ae5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.485122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0279e8ae77e49dea5bd6fb5f2314ae5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.542029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0279e8ae77e49dea5bd6fb5f2314ae5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.581261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5c5c3a42-ca1c-4133-b433-e56159bea9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0279e8ae77e49dea5bd6fb5f2314ae5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:30.606864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 738/1456] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:30 2022] DELETE /identity/v3/users/e0279e8ae77e49dea5bd6fb5f2314ae5 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:31.322472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:31.324039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:31.373040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed7828-910e-442d-8260-959c7d6cfaf0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:31.749632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:31.753917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:31.754604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:31.756319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] PATH_INFO: `/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:31.760024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17dc8bd5f0a4cb196fa3fd924027c93)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:31.773412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:31.919620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:31.926053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17dc8bd5f0a4cb196fa3fd924027c93', 'request_id': 'req-529a03cf-ec4d-4888-8680-f6a56b6a477c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:31.945874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17dc8bd5f0a4cb196fa3fd924027c93', 'request_id': 'req-529a03cf-ec4d-4888-8680-f6a56b6a477c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:31.962738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17dc8bd5f0a4cb196fa3fd924027c93', 'request_id': 'req-529a03cf-ec4d-4888-8680-f6a56b6a477c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:31.991150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] The token cache is being invalidate because project f17dc8bd5f0a4cb196fa3fd924027c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:31.991615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:31.993768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-529a03cf-ec4d-4888-8680-f6a56b6a477c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:31.999512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 719/1457] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:31 2022] DELETE /identity/v3/projects/f17dc8bd5f0a4cb196fa3fd924027c93 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:32.006413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.006413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.007048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.061115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:32.062611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:32.247212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 739/1458] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:32.255333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.255610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.255884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.310578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:32.320331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:32.349746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 720/1459] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:32.352823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:32.366755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331968ae-2522-4921-9d4f-4b78964b2f84 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:32.378935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:32.380117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.381279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.382063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.383702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:32.385496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:32.387516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:32.425148 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 740/1460] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:32.427842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:32.439283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec5c2-0c3b-4323-99f2-80608d476987 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:32.454359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:32.454998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.455517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.455942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.456960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:32.463871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5d1b-72f8-495e-b39c-eedaa3c570a3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:32.541089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 721/1461] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:32 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:32.547123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:32.564791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50781b5-ed4b-4a59-ad0d-79a9ab09c922 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:32.612092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:32.714419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:32.715251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.715725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.717017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.721133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:32.732072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:32.830471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.831012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.832842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.863313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 741/1462] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:32 2022] POST /identity/v3/users => generated 286 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:08:32.868536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:32.894230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] MFA Rules not processed for user `db8a7662772f4ac69378d3f33e5e6098`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:32.898268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:32.901517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ce94-058e-487a-9f12-781d6d853a6d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:32.911095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:32.911750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:32.912029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:32.912301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:32.914832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:32.918020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:32.949901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 742/1463] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:32.950866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:33.017834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30281-1542-44e2-9b56-5199f75303c3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:33.047132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:33.047756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:33.048034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:33.048564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:33.049249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:33.050881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d611-1e2c-431b-885e-7631cb41f44c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:33.116225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 722/1464] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:33.139002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 743/1465] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:33.143930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:33.162166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ae10-d1d9-48be-b72f-1979dfc8d35a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:33.176027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:33.176750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:33.177035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:33.177310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] PATH_INFO: `/v3/projects/44d294dc9b0a44649f4b92c2a28ed468/users/0f9da335650a4c1d9714332e21ff0cb5/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:33.210096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d294dc9b0a44649f4b92c2a28ed468, user_id=0f9da335650a4c1d9714332e21ff0cb5, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:33.215275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:33.247702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 723/1466] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:33 2022] PUT /identity/v3/projects/44d294dc9b0a44649f4b92c2a28ed468/users/0f9da335650a4c1d9714332e21ff0cb5/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:33.258902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:33.259218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:33.259664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:33.364929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] MFA Rules not processed for user `0f9da335650a4c1d9714332e21ff0cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:33.370956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:33.606106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 744/1467] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:33.623298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:33.628605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:33.849860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fd19c-5ec3-4634-8b96-55fdda4358c3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:33.857419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:33.858056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:33.858472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:33.858752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:33.878683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:33.878683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053595d-94b5-476d-8e09-f1f70fd6877d service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:33.912206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 724/1468] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:33.936782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:34.197460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0a70-f8df-4506-9009-e7db4a24a8f5 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:34.209940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:34.210687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:34.211194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:34.211621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] PATH_INFO: `/v3/users/0f9da335650a4c1d9714332e21ff0cb5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:34.216390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9da335650a4c1d9714332e21ff0cb5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:34.228444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:34.302382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:34.386237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9da335650a4c1d9714332e21ff0cb5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:34.389828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9da335650a4c1d9714332e21ff0cb5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:34.411443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9da335650a4c1d9714332e21ff0cb5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:34.475562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9da335650a4c1d9714332e21ff0cb5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:34.523261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-137f75ca-6b22-41c6-b5aa-5c2d2b95537a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9da335650a4c1d9714332e21ff0cb5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:34.539358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 745/1469] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:33 2022] DELETE /identity/v3/users/0f9da335650a4c1d9714332e21ff0cb5 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:34.544942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:34.545431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:34.545779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:34.565904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:34.566502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:34.566864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:34.631191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:34.633460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:34.661017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:34.663802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:34.774457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:34.939613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 725/1470] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:34.980980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:34.982809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:35.001752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 746/1471] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Oct 23 00:08:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:35.009238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523e074-9bf7-4161-8be2-d9d6a1139e9e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:35.029859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:35.035866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:35.036707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:35.037452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.038846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.042335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.064040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:35.071182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:35.095686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8e97-bafd-4f4e-b51f-d3f4b8f85e2c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:35.099026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 726/1472] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:35.126185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:35.129424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.130860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.132028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] PATH_INFO: `/v3/projects/05f5324e9dac4e3a837631ed209e9dc3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.134770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f5324e9dac4e3a837631ed209e9dc3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:35.140424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:35.203492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:35.205092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:35.226367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb817f-52a3-44ff-b9a1-7b342565bf73 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:35.244573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:35.246276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.252590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.254286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.285717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:35.292746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0e4c5-3e82-4c63-8048-46940775231a service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:35.325582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f5324e9dac4e3a837631ed209e9dc3', 'request_id': 'req-6ba450a5-e069-40ae-957f-bc486518f211'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:35.339111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 727/1473] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:35.361066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f5324e9dac4e3a837631ed209e9dc3', 'request_id': 'req-6ba450a5-e069-40ae-957f-bc486518f211'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:35.384453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f5324e9dac4e3a837631ed209e9dc3', 'request_id': 'req-6ba450a5-e069-40ae-957f-bc486518f211'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:35.422831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] The token cache is being invalidate because project 05f5324e9dac4e3a837631ed209e9dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:35.423915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:35.429353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6ba450a5-e069-40ae-957f-bc486518f211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:35.438614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 747/1474] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:35 2022] DELETE /identity/v3/projects/05f5324e9dac4e3a837631ed209e9dc3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:35.443640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.444028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.444253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.492674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:35.494952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:35.671783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 728/1475] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:35.682386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.682839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.683433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.740620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:35.741922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:35.767106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 748/1476] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:35.772174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:35.782778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb17d-5eed-4fea-b677-caf7270fc283 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:35.797831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:35.799147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.799437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.799728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.800373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:35.800678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:35.802299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:35.847321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:35.855317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 729/1477] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:35.859011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6ad9f-f734-4bc1-bdb0-6cdeb9ab2a01 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:35.888232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:35.892103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:35.892417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:35.892759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:35.901109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:35.907418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:35.987797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 749/1478] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:35 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:08:35.988651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:36.012728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86605a0e-df96-4d87-ac60-fb251d23ddf9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:36.263361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:36.264299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:36.264718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:36.265154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:36.265934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:36.274478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:36.347940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:36.348470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 730/1479] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:35 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:36.354422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:36.369021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f406-b537-4957-9cf2-d931f84a1537 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:36.391305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:36.392143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:36.392521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:36.393543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:36.394349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:36.396277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:36.443276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 750/1480] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:36.444917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:36.471738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f25e8-6e78-4c39-a7e8-7564fbf607c4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:36.493892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:36.496635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:36.497488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:36.506000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:36.507067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:36.509980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f206e-404c-48da-a52f-a0c807c5e6db admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:36.626556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 731/1481] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:36.631406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:36.649833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad174bc-38df-4ecf-8354-e98e8f1aaf66 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:36.673086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:36.674516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:36.676975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:36.684663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] PATH_INFO: `/v3/projects/c950a430bc7e49f9801bc432acb50d6c/users/aaa38f15abdd416e9607a0ca809db822/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:36.747156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c950a430bc7e49f9801bc432acb50d6c, user_id=aaa38f15abdd416e9607a0ca809db822, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:36.750615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:36.788815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 751/1482] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:36 2022] PUT /identity/v3/projects/c950a430bc7e49f9801bc432acb50d6c/users/aaa38f15abdd416e9607a0ca809db822/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:36.801235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:36.801796 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:36.802364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:36.858665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:36.894722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] MFA Rules not processed for user `aaa38f15abdd416e9607a0ca809db822`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:36.897955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:37.159391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 732/1483] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:37.160738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:37.316886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e607b6-b1b5-426d-9eaf-c29a2ed1061c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:37.330135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:37.331511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:37.331895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:37.332276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:37.333080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:37.335247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:37.404444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 752/1484] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:37 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:37.413755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:37.461996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2469d-47db-4141-99d3-021dd604a802 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:37.597566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:37.599950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:37.901947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:37.912978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:37.913472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:37.913896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:37.917567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:37.921808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.006590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 733/1485] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:37 2022] POST /identity/v3/users => generated 289 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:38.014295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.015411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da832dc-eb07-4c6a-a3d8-2a5bd99d0e09 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.050366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.051997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.052279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.052659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] PATH_INFO: `/v3/projects/44d294dc9b0a44649f4b92c2a28ed468` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.056842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d294dc9b0a44649f4b92c2a28ed468)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.070672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.073716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920378e-ed6b-437d-ad3b-69438f731356 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.089414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.092266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.092569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.098147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.099210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.104916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.148574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 734/1486] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:38.153395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.210978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9639-d5b6-4442-9841-f7b6c918bce6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.235600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.236486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.236764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.237055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] PATH_INFO: `/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a/users/d5d09f852e9345cb877de5b179a755db/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.265926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d294dc9b0a44649f4b92c2a28ed468', 'request_id': 'req-5269dbf2-c6d5-49de-965e-b5317d592527'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:38.274941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:38.279796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d294dc9b0a44649f4b92c2a28ed468', 'request_id': 'req-5269dbf2-c6d5-49de-965e-b5317d592527'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:38.293216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d294dc9b0a44649f4b92c2a28ed468', 'request_id': 'req-5269dbf2-c6d5-49de-965e-b5317d592527'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:38.308959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1ddc8139834a1ca7bb165ad188e03a, user_id=d5d09f852e9345cb877de5b179a755db, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.320510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.322316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] The token cache is being invalidate because project 44d294dc9b0a44649f4b92c2a28ed468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:38.323032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:38.324687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5269dbf2-c6d5-49de-965e-b5317d592527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:38.329503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 753/1487] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:37 2022] DELETE /identity/v3/projects/44d294dc9b0a44649f4b92c2a28ed468 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:38.336747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510970-f735-4b93-8427-42ef90c46d56 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.337778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510970-f735-4b93-8427-42ef90c46d56 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.338848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510970-f735-4b93-8427-42ef90c46d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.375650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 735/1488] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:38 2022] PUT /identity/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a/users/d5d09f852e9345cb877de5b179a755db/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:38.378153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.384115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:38.446978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cd510970-f735-4b93-8427-42ef90c46d56 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:38.448281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cd510970-f735-4b93-8427-42ef90c46d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:38.625261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:38.661530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562695b-6657-4b4c-b178-b19778a6e38d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.679859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.680700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.682144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.682642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.683453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.685314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.694489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 754/1489] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:38.701966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 736/1490] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:38.704962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.705332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.705604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.709691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.724943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cb71-87ea-49d9-8d01-1a69ff67f10d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.729698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:38.731329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:38.743504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 755/1491] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:38.748439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.749609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.750297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.750569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.750916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] PATH_INFO: `/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a/users/d5d09f852e9345cb877de5b179a755db/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.755760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1ddc8139834a1ca7bb165ad188e03a, user_id=d5d09f852e9345cb877de5b179a755db, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.758430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc2f01-b0a8-4cec-accc-0e03ff3fd835 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.760479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed458d-e5dc-4879-b96e-6a7799ecf946 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.767235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:38.769712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.770410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.770953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.771739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:38.772068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:38.773807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:38.796012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 756/1492] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:38.807055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 737/1493] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:38 2022] PUT /identity/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a/users/d5d09f852e9345cb877de5b179a755db/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:38.818683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:38.818978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:38.819312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:38.820142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:38.845332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55470c-5229-4085-be00-53644a40e561 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:38.933364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] MFA Rules not processed for user `d5d09f852e9345cb877de5b179a755db`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:38.941104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:39.055713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.059609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.059913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.061007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.061677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.063675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.122532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 738/1494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:39.139665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:39.141512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:39.176335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 757/1495] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:38 2022] POST /identity/v3/projects => generated 361 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:39.181526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:39.232239 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2be42-decc-4e31-90a3-b1088c087dc3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:39.395507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:39.417905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.418633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.419863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.420914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.423560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0103-8b12-4b97-b24f-e6052e6a9df5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:39.441637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.442728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.443262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.443688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.444506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.446851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.496497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 758/1496] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:39 2022] POST /identity/v3/users => generated 281 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:39.501459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:39.543025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fad77-baae-4a91-89ee-fcaf8a1a0e77 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:39.559948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.561240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.561860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.562473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.563866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.566401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.599251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 759/1497] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:39.603057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:39.614570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:39.636327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ea5c-606b-4f06-959c-8ba3d6e9eca3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:39.647490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.648520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.649387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.649966 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.651277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.654554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.693967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 760/1498] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:08:39.698112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:39.718755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e986159-a699-4d78-a490-f7a167e01847 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:39.737199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:39.738758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.739478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.740210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] PATH_INFO: `/v3/projects/21fd6692969743a8ae246a2960fde00c/users/8b887c8507e6419da92ac19f75204c06/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.756667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.766727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.785556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fd6692969743a8ae246a2960fde00c, user_id=8b887c8507e6419da92ac19f75204c06, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:39.789330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4690831-bbb5-4751-a405-d5b97469a17b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:39.827099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 761/1499] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:39 2022] PUT /identity/v3/projects/21fd6692969743a8ae246a2960fde00c/users/8b887c8507e6419da92ac19f75204c06/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:39.827596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 739/1500] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:39.829553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05abc8-06b9-4f1a-b6ef-0056192d0b5d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:39.830033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05abc8-06b9-4f1a-b6ef-0056192d0b5d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:39.831264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05abc8-06b9-4f1a-b6ef-0056192d0b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:39.897100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1b05abc8-06b9-4f1a-b6ef-0056192d0b5d None None] MFA Rules not processed for user `8b887c8507e6419da92ac19f75204c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:39.898580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1b05abc8-06b9-4f1a-b6ef-0056192d0b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:40.054366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:40.067388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62857a-268c-4ae5-8f6c-a8d687a4e882 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:40.085927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 762/1501] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:40.254088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:40.254738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:40.255020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:40.255322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:40.266613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:40.478352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:40.482344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:40.508201 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 740/1502] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:40.666890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:40.666890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:40.667758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:40.730429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] MFA Rules not processed for user `a925c18e67894c06863e68b2793488d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:40.731957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:40.843351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:40.845384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:40.871302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953ea0-992f-4c6d-b91c-c33f14996821 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:40.891140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:40.893781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:40.898824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:40.899225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:40.952694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:40.957209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9fc1-8b50-4949-a749-18d99e568e18 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:40.966438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 763/1503] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:40.999596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 741/1504] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:41.036600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:41.157998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:41.251397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ca0c9-0c8a-4ee7-8587-9286575fd4c9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:41.259348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:41.260912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:41.261664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:41.262228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] PATH_INFO: `/v3/users/8b887c8507e6419da92ac19f75204c06` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:41.263824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b887c8507e6419da92ac19f75204c06)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:41.268765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:41.382160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b887c8507e6419da92ac19f75204c06'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:41.382846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b887c8507e6419da92ac19f75204c06'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:41.399424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b887c8507e6419da92ac19f75204c06'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:41.418891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b887c8507e6419da92ac19f75204c06'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:41.433558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b887c8507e6419da92ac19f75204c06'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:41.442802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 764/1505] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:41 2022] DELETE /identity/v3/users/8b887c8507e6419da92ac19f75204c06 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:41.447154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65781-dc01-45c4-b06d-3730e8b846bb None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:41.448041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65781-dc01-45c4-b06d-3730e8b846bb None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:41.448319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65781-dc01-45c4-b06d-3730e8b846bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:41.471378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-47f65781-dc01-45c4-b06d-3730e8b846bb None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:41.472807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-47f65781-dc01-45c4-b06d-3730e8b846bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:41.573327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 742/1506] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:41.593746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:41.597631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:41.696807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aeb1c-0563-4d6b-a992-fc1b6a1c8279 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:41.702366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:41.703458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:41.703830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:41.705446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:41.725906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:41.727241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d425a6-d520-4712-bf7a-d2a4bdc176ed service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:41.744088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 765/1507] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:42.180227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c6ed8-7da0-4a30-b2f0-989894606f1a None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:42.180942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c6ed8-7da0-4a30-b2f0-989894606f1a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:42.181547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c6ed8-7da0-4a30-b2f0-989894606f1a None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:42.183786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 743/1508] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:42.203787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:42.204596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:42.205761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:42.258198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:42.262443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:42.309725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bed7c-d20f-406d-a16b-89f8083437b3 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:42.310002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bed7c-d20f-406d-a16b-89f8083437b3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:42.310457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bed7c-d20f-406d-a16b-89f8083437b3 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:42.312583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 744/1509] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:42.356439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed630-93e4-4ca7-a2af-5b32baf5fa6d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:42.356721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed630-93e4-4ca7-a2af-5b32baf5fa6d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:42.357021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed630-93e4-4ca7-a2af-5b32baf5fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:42.401316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ea6ed630-93e4-4ca7-a2af-5b32baf5fa6d None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:42.405413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:42.405641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ea6ed630-93e4-4ca7-a2af-5b32baf5fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:42.428840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:42.461625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 766/1510] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:42.614585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 745/1511] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:42.799213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:42.800616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:42.830977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee486a-7bc3-49b2-a0e7-049e7d3e7b44 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:42.844073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:42.844738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:42.845016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:42.845287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] PATH_INFO: `/v3/projects/21fd6692969743a8ae246a2960fde00c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:42.847061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fd6692969743a8ae246a2960fde00c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:42.848929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:42.973734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fd6692969743a8ae246a2960fde00c', 'request_id': 'req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:42.988664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fd6692969743a8ae246a2960fde00c', 'request_id': 'req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:43.004648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fd6692969743a8ae246a2960fde00c', 'request_id': 'req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:43.036162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] The token cache is being invalidate because project 21fd6692969743a8ae246a2960fde00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:43.036726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:43.041100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:43.045241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 767/1512] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:42 2022] DELETE /identity/v3/projects/21fd6692969743a8ae246a2960fde00c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:43.050382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af40ff-b384-484b-8729-d4a8d4248064 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.050873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af40ff-b384-484b-8729-d4a8d4248064 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.051247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af40ff-b384-484b-8729-d4a8d4248064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.077806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c7af40ff-b384-484b-8729-d4a8d4248064 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:43.079814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c7af40ff-b384-484b-8729-d4a8d4248064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:43.187959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.188250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 746/1513] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:43.196578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.197091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.197473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:43.197596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.245401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:43.246652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:43.274589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 747/1514] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:43.276318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.298764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a2326-d5d4-4432-a72a-ce2b0bb73d9b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.311741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.312976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.313790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.314827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.316265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:43.316525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.319652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.345064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 748/1515] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:43.347934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.361034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ccdcc-5758-4e8b-aa37-ed561f2e8d5b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.362061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a8e-4d45-4cd5-8db6-7b2339f02a6f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.368964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.370406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.370786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.371060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.371524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.371651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.371805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.372257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.372728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.374398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:43.375270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.390965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.393450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.409463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 768/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:43.449004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 749/1517] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:43 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:43.450362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.475300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed669f8-846e-4c59-b031-8c55b880fe08 service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.531741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.568295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:43.584789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.585853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.586311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.586741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.587708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.590000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.603893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:43.620269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d654b-ff3d-4e5a-85b7-9a1779b14b89 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.626906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.627709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.628085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.628454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.630645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:43.644430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.646261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.657136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 769/1518] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:43 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:43.659115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.661176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 750/1519] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:43.674912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341232-4ed3-4fc9-8e93-65f46f3105cb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.683145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.683676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.684270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.695706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.696536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.699048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.716766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 770/1520] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:43.724639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.742066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de3cc-d82c-4991-8245-21d5cc7b121e service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.748691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.749420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.749918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.750289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.751430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.754377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5c56d-b927-4878-9811-0109ed957ff4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.771264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 751/1521] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:43.783391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:43.801793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b37ad-baae-4b4a-a701-84af7166e2fb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:43.816061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:43.817131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.817597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.818490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] PATH_INFO: `/v3/projects/f7115ce68dd2403a9bde6f43c21c532f/users/c3917d33179b438d81511e0d73d8a176/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.851474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7115ce68dd2403a9bde6f43c21c532f, user_id=c3917d33179b438d81511e0d73d8a176, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:43.854719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:43.871183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 771/1522] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:43 2022] PUT /identity/v3/projects/f7115ce68dd2403a9bde6f43c21c532f/users/c3917d33179b438d81511e0d73d8a176/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:43.882613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:43.882969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:43.883335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:43.913792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] MFA Rules not processed for user `c3917d33179b438d81511e0d73d8a176`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:43.915314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:44.027085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 752/1523] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:44.038849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:44.040883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:44.130982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662db67-00cf-44e7-b3d7-310fae96ee9c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:44.140556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:44.142454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:44.143177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:44.143567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:44.162895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:44.175834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21f73-7d5e-49e3-b612-cf7a42d6c3cf service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:44.185672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 772/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:46.745695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:46.747407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:46.839610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec63da-d87c-465d-b0f2-490e00abda5a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:46.844138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:46.844765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:46.845052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:46.845332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] PATH_INFO: `/v3/users/aaa38f15abdd416e9607a0ca809db822` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:46.847094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa38f15abdd416e9607a0ca809db822)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:46.849009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:46.897921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa38f15abdd416e9607a0ca809db822'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:46.906247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa38f15abdd416e9607a0ca809db822'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:46.915323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa38f15abdd416e9607a0ca809db822'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:46.920518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:46.931631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa38f15abdd416e9607a0ca809db822'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:46.932264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa38f15abdd416e9607a0ca809db822'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:46.938792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 753/1525] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:46 2022] DELETE /identity/v3/users/aaa38f15abdd416e9607a0ca809db822 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:46.943347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:46.943850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:46.943941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:46.964465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:46.965680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:47.030768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 773/1526] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:47.041281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:47.042748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:47.106676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36322839-db79-4f7e-b991-c0014159e8ad admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:47.110346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:47.110978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:47.111292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:47.111598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:47.120961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:47.122379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:47.132465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 754/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:47.450048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:47.451747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:47.469762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61801e05-1601-4caf-a838-e0edb29f221e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:47.474816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:47.475608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:47.475886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:47.476341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] PATH_INFO: `/v3/projects/c950a430bc7e49f9801bc432acb50d6c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:47.478037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c950a430bc7e49f9801bc432acb50d6c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:47.480142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:47.528674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:47.537120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c950a430bc7e49f9801bc432acb50d6c', 'request_id': 'req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.543313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c950a430bc7e49f9801bc432acb50d6c', 'request_id': 'req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.550609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c950a430bc7e49f9801bc432acb50d6c', 'request_id': 'req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.565733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] The token cache is being invalidate because project c950a430bc7e49f9801bc432acb50d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:47.566329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.567002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e136ca04-ffb5-4f57-b2a3-fea8786ca3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.569048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 774/1528] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:47 2022] DELETE /identity/v3/projects/c950a430bc7e49f9801bc432acb50d6c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:47.573392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:47.583774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc3ab-9c19-4091-97e4-eb81b111b5f5 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:47.646751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:47.647420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:47.647699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:47.647973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] PATH_INFO: `/v3/users/d5d09f852e9345cb877de5b179a755db` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:47.649110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d09f852e9345cb877de5b179a755db)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:47.651040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:47.705908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d09f852e9345cb877de5b179a755db'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.713324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d09f852e9345cb877de5b179a755db'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.721171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d09f852e9345cb877de5b179a755db'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.739200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d09f852e9345cb877de5b179a755db'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.739916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7e7d1a86-2da1-4ab3-b4d9-1a38cd209fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d09f852e9345cb877de5b179a755db'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:47.746349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 755/1529] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:47 2022] DELETE /identity/v3/users/d5d09f852e9345cb877de5b179a755db => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:48.848056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:48.848558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:48.848633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:48.850046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 775/1530] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:08:48.886178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:48.886668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:48.886743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:48.901971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:48.914148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:48.915935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.053246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 756/1531] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:08:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:49.128462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.130677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.161621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232304c-9498-4f0c-aa84-85af40cb703e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:49.170076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:49.171161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.171783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.172429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.196511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:49.198503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181532ea-5f98-4d5b-8906-5440789a1586 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:49.214350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.214716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 776/1532] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:49.216038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.397568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe816a1-4836-4989-8eef-40146bf50b9c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:49.410764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:49.411475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.411756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.412089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] PATH_INFO: `/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.413804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1ddc8139834a1ca7bb165ad188e03a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:49.418969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:49.519230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1ddc8139834a1ca7bb165ad188e03a', 'request_id': 'req-9e86dbdf-cdf6-4fe0-9288-42d48a768449'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.532229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1ddc8139834a1ca7bb165ad188e03a', 'request_id': 'req-9e86dbdf-cdf6-4fe0-9288-42d48a768449'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.540037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1ddc8139834a1ca7bb165ad188e03a', 'request_id': 'req-9e86dbdf-cdf6-4fe0-9288-42d48a768449'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.554320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] The token cache is being invalidate because project 8d1ddc8139834a1ca7bb165ad188e03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:49.554615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.555330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.556997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 757/1533] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:49 2022] DELETE /identity/v3/projects/8d1ddc8139834a1ca7bb165ad188e03a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:49.562796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9c3-fd10-4180-a36d-c77a2dc0fda8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.563109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9c3-fd10-4180-a36d-c77a2dc0fda8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.563391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9c3-fd10-4180-a36d-c77a2dc0fda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.583433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d6c6f9c3-fd10-4180-a36d-c77a2dc0fda8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:49.585001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d6c6f9c3-fd10-4180-a36d-c77a2dc0fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.651455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.652098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.663190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 777/1534] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:49.664768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.665060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.665339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.674542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86dbdf-cdf6-4fe0-9288-42d48a768449 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:49.681425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:49.682675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.682964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.683339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] PATH_INFO: `/v3/users/c3917d33179b438d81511e0d73d8a176` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.684867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3917d33179b438d81511e0d73d8a176)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:49.686941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:49.689018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:49.690266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:49.700963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 778/1535] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:49.706015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.716495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001fbd1-6ea1-4371-87ab-4488b581b3b9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:49.722342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:49.723415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.723415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.723626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.724748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:49.725024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:49.727021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:49.743165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 779/1536] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:08:49.748363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.749802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:49.769305 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f50e-277d-4274-a22c-e98169f28712 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:49.775939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:49.777108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.777108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.777412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.777988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:49.780255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:49.794720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3917d33179b438d81511e0d73d8a176'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.808880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3917d33179b438d81511e0d73d8a176'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.826893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3917d33179b438d81511e0d73d8a176'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.844740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 780/1537] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:49 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:49.849157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:49.859015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3917d33179b438d81511e0d73d8a176'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.859778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-848d60d2-a7fa-420b-8f8a-4e6d4b5aeb8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3917d33179b438d81511e0d73d8a176'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:49.896273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 758/1538] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:49 2022] DELETE /identity/v3/users/c3917d33179b438d81511e0d73d8a176 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:49.899032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:49.899431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:49.899719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:49.931961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:49.933641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.003664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92646427-cedf-4c88-b3da-1d8aa8f856b0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.065923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:50.105602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 759/1539] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:50.112897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.116911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.130682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.142644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.143225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.143676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.144561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.146519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.172774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 781/1540] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:49 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:50.177067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.182672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.196046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1eb43-d646-4ecf-b6e0-9701bff5f4ae admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.206786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8162a9b-629e-4ed8-9766-4f600ed84f4e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.207236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.208122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.208589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.209099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.209914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.211741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.222431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.223312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.223677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.224036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.225215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 782/1541] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:50.229175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.241934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d8f-05f5-4d50-a7e0-a289e7ec429e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.247629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.248613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.248723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.248937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.249591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.252138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.260641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.264025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5660-e6a6-4643-91d0-b2b1f8728611 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.264647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 783/1542] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:50.268999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.279647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba45f-b2b9-4489-b83c-3c785dd42114 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.280216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 760/1543] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:50.284760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.285429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.285713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.285987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] PATH_INFO: `/v3/projects/e59ca8a0d0bc43ab9c3e065a4a57a168/users/ad8123fa4d8349c5b12261604e4761d3/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.302333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59ca8a0d0bc43ab9c3e065a4a57a168, user_id=ad8123fa4d8349c5b12261604e4761d3, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.304968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.323964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 784/1544] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:50 2022] PUT /identity/v3/projects/e59ca8a0d0bc43ab9c3e065a4a57a168/users/ad8123fa4d8349c5b12261604e4761d3/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:50.337158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.339418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.339809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.388937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] MFA Rules not processed for user `ad8123fa4d8349c5b12261604e4761d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:50.390341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.434688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:50.496206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 761/1545] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:50.518698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.521272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.663364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71866-9c9f-4bb2-bf3a-10f888399229 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.668345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.669325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.669826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.670273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.681528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.683571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.695851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 785/1546] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:50.726610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.880760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba5634-3c90-4ce4-a7c0-71c16ed5e925 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.886923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.887771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.888461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.889215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] PATH_INFO: `/v3/users/ad8123fa4d8349c5b12261604e4761d3` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.906315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8123fa4d8349c5b12261604e4761d3)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.906315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:50.930024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:50.931556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:50.957104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc1a7-48f9-49c3-8c14-c351d95fc9cb service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:50.981865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:50.981865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:50.981865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:50.981865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] PATH_INFO: `/v3/projects/f7115ce68dd2403a9bde6f43c21c532f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:50.982417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7115ce68dd2403a9bde6f43c21c532f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:50.984552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.058851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8123fa4d8349c5b12261604e4761d3'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.074942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8123fa4d8349c5b12261604e4761d3'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.091154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8123fa4d8349c5b12261604e4761d3'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.129386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8123fa4d8349c5b12261604e4761d3'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.130971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31e2b9cb-ef93-4c5c-874b-3ec6248da6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8123fa4d8349c5b12261604e4761d3'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.145143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7115ce68dd2403a9bde6f43c21c532f', 'request_id': 'req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.161046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 762/1547] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:08:50 2022] DELETE /identity/v3/users/ad8123fa4d8349c5b12261604e4761d3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:51.167419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7115ce68dd2403a9bde6f43c21c532f', 'request_id': 'req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.169554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be33b-2541-416a-a247-db44a0916657 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.170111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be33b-2541-416a-a247-db44a0916657 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.170747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be33b-2541-416a-a247-db44a0916657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.194266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7115ce68dd2403a9bde6f43c21c532f', 'request_id': 'req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.198383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:51.208559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-583be33b-2541-416a-a247-db44a0916657 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:51.210621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-583be33b-2541-416a-a247-db44a0916657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:51.214027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] The token cache is being invalidate because project f7115ce68dd2403a9bde6f43c21c532f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:51.215600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.217546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cbb13311-2e81-4b70-8f33-dbf39ccc18fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:51.219597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 786/1548] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:50 2022] DELETE /identity/v3/projects/f7115ce68dd2403a9bde6f43c21c532f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:08:51.225630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23331dd-611f-4a85-9923-f26b15188534 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.225955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23331dd-611f-4a85-9923-f26b15188534 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.226220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23331dd-611f-4a85-9923-f26b15188534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.250652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e23331dd-611f-4a85-9923-f26b15188534 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:51.252720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e23331dd-611f-4a85-9923-f26b15188534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:51.340195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:51.351297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 787/1549] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:51.353161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.353520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.354102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.369374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 763/1550] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:51.383952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:51.385612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:51.390069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be33b-2541-416a-a247-db44a0916657 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.394347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-583be33b-2541-416a-a247-db44a0916657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:51.396807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 788/1551] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:51.406108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.431864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620ee17-173b-4557-ab29-ca9204535f1d None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.445355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.446834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.447136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.447414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.455916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:51.456238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.459495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.493991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 789/1552] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:51.495325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.513675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92400a-aaa7-4ee0-ab41-188a3ee48767 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.526230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.528774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.540399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.540729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.541523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.545131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.551554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be33b-2541-416a-a247-db44a0916657 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.560755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.561389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.561670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.561945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.583485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.584957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.606133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 764/1553] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:08:51.616795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 790/1554] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:51.619415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.643643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394198-2dcb-4f54-a224-894d3d655341 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.744459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.746501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.746750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.746972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.747621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.749576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.797209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 765/1555] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:51.801591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.812906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966ba4-72e8-4066-b2e9-b88d2fe874be admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.819991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.820707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.821112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.821458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.822237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.823981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.837501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 791/1556] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:51.841133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.856218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76b86a-0ad1-4cff-91c4-ec55a00d71b1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.863747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.864590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.865016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.865433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.866247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.868900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e180cd-7a70-44f4-9505-69774030d22b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.883108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 766/1557] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:51.887593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:51.902608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfbda-d2cc-463b-af17-4054f05fe7bc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:51.911025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:51.912250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.912764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.913426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] PATH_INFO: `/v3/projects/9bca9295155c41c88e9e883980e345f1/users/4a4c9498d13d451a80522437aff25237/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:51.936915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bca9295155c41c88e9e883980e345f1, user_id=4a4c9498d13d451a80522437aff25237, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:51.957467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:51.990867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 792/1558] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:51 2022] PUT /identity/v3/projects/9bca9295155c41c88e9e883980e345f1/users/4a4c9498d13d451a80522437aff25237/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:51.995642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:51.996254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:51.996254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.024268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:52.026485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:52.116502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 767/1559] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:52.141505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:52.169733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:52.170703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:52.186329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe5697-7716-4b7e-8115-c18b7d851c02 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:52.193146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:52.194115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.194592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.196902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] PATH_INFO: `/v3/projects/e59ca8a0d0bc43ab9c3e065a4a57a168` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.198519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59ca8a0d0bc43ab9c3e065a4a57a168)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:52.201327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:52.232442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:52.302163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd1a1-92a2-486c-beb5-d55775eeef37 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:52.305969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59ca8a0d0bc43ab9c3e065a4a57a168', 'request_id': 'req-524576e3-91de-440e-8fa0-8c54df045a9d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:52.318515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59ca8a0d0bc43ab9c3e065a4a57a168', 'request_id': 'req-524576e3-91de-440e-8fa0-8c54df045a9d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:52.332990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59ca8a0d0bc43ab9c3e065a4a57a168', 'request_id': 'req-524576e3-91de-440e-8fa0-8c54df045a9d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:52.353555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:52.364397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] The token cache is being invalidate because project e59ca8a0d0bc43ab9c3e065a4a57a168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:08:52.364397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:52.365210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-524576e3-91de-440e-8fa0-8c54df045a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:08:52.368663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 768/1560] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:08:52 2022] DELETE /identity/v3/projects/e59ca8a0d0bc43ab9c3e065a4a57a168 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:52.374070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.374261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.374952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.411004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:52.411004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.411004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.411004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.413023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:52.418243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:52.420258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:52.589517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:52.590714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c4a2-97ac-4693-82ca-2b526a7a2891 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:52.604918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 793/1561] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:52.631516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 769/1562] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:52.632788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.633348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.633770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.676034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:52.677285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:52.726166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 794/1563] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:08:52.730589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:52.741278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260e19-343e-486d-9881-9c75f11db956 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:52.746978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:52.748037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.748037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.748316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.749350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:08:52.750089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:52.751609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:52.778497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 770/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:08:52.780158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:52.794016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1712-3b4c-45fe-a1df-130ace2b20e7 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:52.808832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:52.809729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.810011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.810295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.812480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:52.814529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:52.866965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 795/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:08:52 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:52.870537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:52.902360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b052b-636e-4ff4-a145-edaf10bde287 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:52.996927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:52.998502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:52.998502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:52.998693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:52.999522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:53.002787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:53.036963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 771/1566] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:08:52 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:08:53.041186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:53.057786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fe626-6722-46d6-b06e-08b7b92568e2 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:53.066973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:53.068347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:53.068692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:53.068979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:53.070027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:53.072440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:53.098656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 796/1567] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:53.103153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:53.117452 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2444-d9f9-4f26-8cea-d62d39a829f1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:53.123859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:53.124646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:53.124923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:53.125197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:53.125948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:53.128951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b291-a401-4f72-a099-2d3345f34321 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:53.146151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 772/1568] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:08:53.151187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:53.166640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68df4d-fd89-4d8e-9a7c-aed57efe4468 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:53.174970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:53.175788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:53.176167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:53.176547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] PATH_INFO: `/v3/projects/1eac5824a102449b9785974257757b27/users/f3b20233d9cf4e978c5b03a34c0cf606/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:53.195953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eac5824a102449b9785974257757b27, user_id=f3b20233d9cf4e978c5b03a34c0cf606, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:53.199520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:53.237468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 797/1569] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:08:53 2022] PUT /identity/v3/projects/1eac5824a102449b9785974257757b27/users/f3b20233d9cf4e978c5b03a34c0cf606/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:08:53.248899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbfac2-36e7-4ae5-accb-9fe34283abb7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:53.249307 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbfac2-36e7-4ae5-accb-9fe34283abb7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:53.249838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbfac2-36e7-4ae5-accb-9fe34283abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:53.272497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:08:53.321412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-18bbfac2-36e7-4ae5-accb-9fe34283abb7 None None] MFA Rules not processed for user `f3b20233d9cf4e978c5b03a34c0cf606`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:53.322978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-18bbfac2-36e7-4ae5-accb-9fe34283abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:53.449611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 773/1570] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:08:53.462941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:08:53.465826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:08:53.564102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1db44-22f1-4a46-8e63-9714e918d29b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:08:53.569145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:08:53.571027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:53.571358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:53.571633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:53.589843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:08:53.592555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:08:53.623278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 798/1571] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:08:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:08:59.857273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:08:59.858094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:08:59.858375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:08:59.890598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] MFA Rules not processed for user `4a4c9498d13d451a80522437aff25237`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:08:59.892381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:00.005779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 774/1572] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:08:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:00.007597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.010436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:00.073750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:00.192402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca9d52-8a73-4520-93ab-1dddd48b5ffe service glance] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.199817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.200702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.201095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.201451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.202221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.205785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.254021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 799/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:00 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:00.258205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.287949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484498b2-8127-4adc-a410-752954a5caa8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.376231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.377378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.377663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.378263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.379419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.381663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.410718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 775/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:00 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:00.414565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.428448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c345e52-6b95-412f-9700-46cf34b625b2 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.433850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.434629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.435009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.435417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.436226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.438787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.451746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 800/1575] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:00.456091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.466623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b93f-8def-40c0-b621-c5472a882876 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.472205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.472865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.473152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.473424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] PATH_INFO: `/v3/projects/0712f4973a2b4b6cb3df9016bb94581f/users/44c1b763cdfc4f7ea1044db80c76c6b1/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.488161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:00.491503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0712f4973a2b4b6cb3df9016bb94581f, user_id=44c1b763cdfc4f7ea1044db80c76c6b1, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.494381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.510539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 776/1576] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:00 2022] PUT /identity/v3/projects/0712f4973a2b4b6cb3df9016bb94581f/users/44c1b763cdfc4f7ea1044db80c76c6b1/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:00.521310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.538141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58ec9d-2fc2-4df4-ae7a-239b5591c0aa admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.642922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.644456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.644810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.645152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.647182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.649803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.677654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 801/1577] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:00.681479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:00.698466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc28a9-5297-407d-ba61-d505cb7b1abe admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:00.709124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:00.709931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:00.710216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:00.710475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] PATH_INFO: `/v3/projects/0712f4973a2b4b6cb3df9016bb94581f/users/44c1b763cdfc4f7ea1044db80c76c6b1/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:00.713282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0712f4973a2b4b6cb3df9016bb94581f, user_id=44c1b763cdfc4f7ea1044db80c76c6b1, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:00.734536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce7ed-17ed-4b5d-9fd5-a75aef55c003 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:00.768792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 777/1578] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:00 2022] PUT /identity/v3/projects/0712f4973a2b4b6cb3df9016bb94581f/users/44c1b763cdfc4f7ea1044db80c76c6b1/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:02.203330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:02.207260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:02.238675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14aa18-a3c1-4cee-9147-309409c00487 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:02.327273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:02.328950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:02.330355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:02.330610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] PATH_INFO: `/v3/users/2758f46b62c0493c9a0edaed3a7c6ace` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:02.332048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2758f46b62c0493c9a0edaed3a7c6ace)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:02.335187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:02.397411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:02.420884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2758f46b62c0493c9a0edaed3a7c6ace'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:02.421620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2758f46b62c0493c9a0edaed3a7c6ace'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:02.437984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2758f46b62c0493c9a0edaed3a7c6ace'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:02.476437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2758f46b62c0493c9a0edaed3a7c6ace'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:02.492894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2758f46b62c0493c9a0edaed3a7c6ace'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:02.511405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 802/1579] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:02 2022] DELETE /identity/v3/users/2758f46b62c0493c9a0edaed3a7c6ace => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:02.521902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:02.521902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:02.521902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:02.584068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:02.585905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:02.763197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 778/1580] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:02.820896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:02.823427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:02.995328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261ed41-dd83-4d8a-9ec1-d3bac8389cf8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:03.002436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:03.003133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:03.003391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:03.003648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:03.026377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:03.030993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:03.056215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 803/1581] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:04.119419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:04.126169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:04.142220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec542a-5554-4704-b6d1-58a559e52b3d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:04.152191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:04.152944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:04.153314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:04.153782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] PATH_INFO: `/v3/projects/3f3c9bf0f5464419a57be8ea9fcfe91a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:04.155117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3c9bf0f5464419a57be8ea9fcfe91a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:04.158092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:04.230536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3c9bf0f5464419a57be8ea9fcfe91a', 'request_id': 'req-1b577c23-33f0-40a9-ab40-9d52ae866a86'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.250685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3c9bf0f5464419a57be8ea9fcfe91a', 'request_id': 'req-1b577c23-33f0-40a9-ab40-9d52ae866a86'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.279574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3c9bf0f5464419a57be8ea9fcfe91a', 'request_id': 'req-1b577c23-33f0-40a9-ab40-9d52ae866a86'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.316332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] The token cache is being invalidate because project 3f3c9bf0f5464419a57be8ea9fcfe91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:04.316627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.317297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.318814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 779/1582] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:04 2022] DELETE /identity/v3/projects/3f3c9bf0f5464419a57be8ea9fcfe91a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:04.322818 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:04.335634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44892ed-7425-4829-90a0-f4447ca48998 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:04.465816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:04.467797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:04.468383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:04.471588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] PATH_INFO: `/v3/users/a969507f6b0c485b975e39fdcabaa768` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:04.473210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a969507f6b0c485b975e39fdcabaa768)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:04.476714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:04.556469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a969507f6b0c485b975e39fdcabaa768'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.557655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a969507f6b0c485b975e39fdcabaa768'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.568137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a969507f6b0c485b975e39fdcabaa768'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.569809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:04.589631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a969507f6b0c485b975e39fdcabaa768'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.603234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ad7a92e0-73f0-4c03-87a8-c4288fc43983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a969507f6b0c485b975e39fdcabaa768'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:04.613184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 804/1583] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:04 2022] DELETE /identity/v3/users/a969507f6b0c485b975e39fdcabaa768 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:05.051193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:05.053240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:05.114701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577c23-33f0-40a9-ab40-9d52ae866a86 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:05.264350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:05.265174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:05.265553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:05.265928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] PATH_INFO: `/v3/projects/b24a79dd1b494561a66c4f0c5efd8776` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:05.268834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a79dd1b494561a66c4f0c5efd8776)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:05.271225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:05.273321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:05.446696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a79dd1b494561a66c4f0c5efd8776', 'request_id': 'req-63233f9e-54ce-4795-af06-e6c80d803319'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:05.469876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a79dd1b494561a66c4f0c5efd8776', 'request_id': 'req-63233f9e-54ce-4795-af06-e6c80d803319'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:05.507794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a79dd1b494561a66c4f0c5efd8776', 'request_id': 'req-63233f9e-54ce-4795-af06-e6c80d803319'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:05.542468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] The token cache is being invalidate because project b24a79dd1b494561a66c4f0c5efd8776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:05.542762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:05.543481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63233f9e-54ce-4795-af06-e6c80d803319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:05.545527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 780/1584] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:05 2022] DELETE /identity/v3/projects/b24a79dd1b494561a66c4f0c5efd8776 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:05.551122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:05.554115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:05.554478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:05.647725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:05.650201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:05.805713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 805/1585] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:05.816303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be241-6084-4652-b335-b15c79b27211 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:05.816597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be241-6084-4652-b335-b15c79b27211 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:05.817035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be241-6084-4652-b335-b15c79b27211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:05.909693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-409be241-6084-4652-b335-b15c79b27211 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:05.911105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-409be241-6084-4652-b335-b15c79b27211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:05.928605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 781/1586] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:05.934906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:05.958616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287aa78-3aa0-471e-bdab-95bdb05db8a3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:05.986478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:05.987280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:05.987565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:05.987849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:05.988715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:05.989107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:05.991603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.024044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 806/1587] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:06.026210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be241-6084-4652-b335-b15c79b27211 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.054177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be241-6084-4652-b335-b15c79b27211 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.066409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.068301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.069159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.069546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.070387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.073519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.122521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 782/1588] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:06 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:06.129560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.151664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc613-4bbf-4b98-a258-d3994aa7803d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.281292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.282193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.282625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.283046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.283907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.286001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.318428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 807/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:06 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:06.323028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.339229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01df29-f798-4086-9add-0e8aba0609e2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.349901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.350780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.351236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.351661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.352407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.354011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.386584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 783/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:06.387130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.402348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e190f1-f36d-43fb-bb8d-e384594bff33 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.415198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.415855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.416223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.416394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.417119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.424261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705da28-947a-4da1-8277-1ed844a3aadf admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.457536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.465541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 808/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:06.473636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cc48-cd79-450c-8611-2fd8369962bb admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.478676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.479489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.479770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.480046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] PATH_INFO: `/v3/projects/cfe45d709cff465cae4149d1de99d43a/users/79d6e8b14ec84b95be30a59c777ff5e2/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.502071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe45d709cff465cae4149d1de99d43a, user_id=79d6e8b14ec84b95be30a59c777ff5e2, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.505704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.528186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 784/1592] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:06 2022] PUT /identity/v3/projects/cfe45d709cff465cae4149d1de99d43a/users/79d6e8b14ec84b95be30a59c777ff5e2/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:06.540096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a726-3396-491a-928e-f59b25882483 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.540383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a726-3396-491a-928e-f59b25882483 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.540665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a726-3396-491a-928e-f59b25882483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.581539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3d24a726-3396-491a-928e-f59b25882483 None None] MFA Rules not processed for user `79d6e8b14ec84b95be30a59c777ff5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:06.585340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3d24a726-3396-491a-928e-f59b25882483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:06.651502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:06.714204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.715323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 809/1593] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:06.812590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf1e7-5f3a-463e-b5f7-669dffdbf4b5 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:06.829085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:06.830374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:06.830851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:06.831365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:06.832030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:06.834079 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:06.883474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 785/1594] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:06 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:06.887897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a726-3396-491a-928e-f59b25882483 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:06.904411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a726-3396-491a-928e-f59b25882483 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:07.100571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:07.112775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.113197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.113494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.114414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:07.124796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:07.161489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 810/1595] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:06 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:07.165662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:07.181641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497166-6c08-4dff-b10b-0b4b7f6e560a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:07.192320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:07.193070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.193413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.193752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.194462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:07.199764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:07.208264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:07.222270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 786/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:07.223770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:07.242079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518ceb-5c53-40b6-a819-2d0e12d6ccb3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:07.249746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:07.250687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.251895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.253029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] PATH_INFO: `/v3/projects/c9f0f43cba774589863bba35f9a03459/users/f82aa437d67d4f70b3126dca7d046035/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.282920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f0f43cba774589863bba35f9a03459, user_id=f82aa437d67d4f70b3126dca7d046035, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:07.291522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:07.329469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 811/1597] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:07 2022] PUT /identity/v3/projects/c9f0f43cba774589863bba35f9a03459/users/f82aa437d67d4f70b3126dca7d046035/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:07.333259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:07.345289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469550-9b2a-4162-85c7-f2d5c0d54c8c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:07.505005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:07.507558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.507987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.508401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.510298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:07.512613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21d22-0cad-4375-b5e2-bc1a140d1311 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:07.545558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 787/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:07.549856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:07.567916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b8a-d7b1-4d8a-a18b-8b3906a97648 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:07.579178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:07.580440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.580731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.580976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] PATH_INFO: `/v3/projects/c9f0f43cba774589863bba35f9a03459/users/f82aa437d67d4f70b3126dca7d046035/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.582924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f0f43cba774589863bba35f9a03459, user_id=f82aa437d67d4f70b3126dca7d046035, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:07.585594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:07.615808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 812/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:07 2022] PUT /identity/v3/projects/c9f0f43cba774589863bba35f9a03459/users/f82aa437d67d4f70b3126dca7d046035/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:07.618100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:07.618550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:07.618828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:07.670853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] MFA Rules not processed for user `f82aa437d67d4f70b3126dca7d046035`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:07.672537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:07.858525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 788/1600] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:07.872602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:07.874546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:08.003522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb4a48-066e-4745-bbeb-6a6509bc6262 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:08.008491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:08.009122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:08.009630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:08.009757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:08.022995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:08.025401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e443-4e17-4964-a02e-3a2e49bd2551 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:08.039034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 813/1601] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:08.137903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:08.151045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0605-03bf-457f-97f3-3e288e2de1ce None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:08.155600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:08.156221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:08.156550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:08.156778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:08.229673 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:08.232538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:08.247340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 789/1602] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:11.935495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94444-3e95-41f0-b9af-f004e0f6eee9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:11.935934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94444-3e95-41f0-b9af-f004e0f6eee9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:11.936023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d94444-3e95-41f0-b9af-f004e0f6eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:11.999143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-61d94444-3e95-41f0-b9af-f004e0f6eee9 None None] MFA Rules not processed for user `44c1b763cdfc4f7ea1044db80c76c6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:12.000407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-61d94444-3e95-41f0-b9af-f004e0f6eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.018971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:12.111273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 814/1603] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:12.131732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:12.133869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.179060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:12.226421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c21b-f87e-44b5-894c-1edae7dcef0f service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:12.231252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:12.232315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:12.232787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:12.233243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:12.236216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.320980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:12.322676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:12.335157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 790/1604] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:12.643713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:12.644101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:12.644663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:12.680854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:12.682008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.749083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:12.753428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.851007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 815/1605] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:09:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:12.861351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:12.863468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:12.905774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed78cd-a322-4d9c-bf7f-2d02ddbde470 service glance] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:12.917776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:12.918633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:12.920431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:12.920833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] PATH_INFO: `/v3/users/f3b20233d9cf4e978c5b03a34c0cf606` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:12.923612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b20233d9cf4e978c5b03a34c0cf606)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:12.926385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:13.010281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6abbe1-c088-4c0b-9172-d8812411b32a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:13.016000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b20233d9cf4e978c5b03a34c0cf606'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:13.027610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:13.028269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:13.028556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:13.028836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:13.035625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b20233d9cf4e978c5b03a34c0cf606'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:13.041014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:13.042878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc554d-0b93-4b4f-9389-dae3677fc5a7 service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:13.055193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 816/1606] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:09:13.069806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b20233d9cf4e978c5b03a34c0cf606'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:13.096285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:13.108434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b20233d9cf4e978c5b03a34c0cf606'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:13.109079 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b20233d9cf4e978c5b03a34c0cf606'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:13.117572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 791/1607] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:12 2022] DELETE /identity/v3/users/f3b20233d9cf4e978c5b03a34c0cf606 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:13.121988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:13.122392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:13.122841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:13.161820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:13.168017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:13.605626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:13.652538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 817/1608] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:13.677808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:13.680679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:13.843279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9998-ae8e-4766-aec6-c5d41607d9da admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:13.849345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:13.850226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:13.850804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:13.851272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:13.864608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:13.865742 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68d1b-11b4-4a41-8c66-1fe1844c7b9f service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:13.889651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 792/1609] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:15.077711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:15.079754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:15.106051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea24c-5d48-49c9-beef-214920d69184 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:15.122960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:15.123655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:15.123930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:15.124389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] PATH_INFO: `/v3/projects/1eac5824a102449b9785974257757b27` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:15.128457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eac5824a102449b9785974257757b27)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:15.134291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:15.290139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eac5824a102449b9785974257757b27', 'request_id': 'req-f7d6d4cf-7411-4d68-927d-45c943139d2f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:15.304741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eac5824a102449b9785974257757b27', 'request_id': 'req-f7d6d4cf-7411-4d68-927d-45c943139d2f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:15.322886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eac5824a102449b9785974257757b27', 'request_id': 'req-f7d6d4cf-7411-4d68-927d-45c943139d2f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:15.351826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] The token cache is being invalidate because project 1eac5824a102449b9785974257757b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:15.352398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:15.353824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f7d6d4cf-7411-4d68-927d-45c943139d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:15.361411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 818/1610] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:15 2022] DELETE /identity/v3/projects/1eac5824a102449b9785974257757b27 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:15.366102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:15.366600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:15.366699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:15.405635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:15.407475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:15.579401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 793/1611] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:15.588766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:15.589324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:15.589750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:15.636385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:15.637832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:15.665661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 819/1612] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:15.670481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:15.682642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99817a3a-a9fd-48a4-9ff3-d49132da47a8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:15.691435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:15.693371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:15.693800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:15.694223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:15.695180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:15.695643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:15.697578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:15.721154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 794/1613] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:15.725970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:15.746836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1184d-6962-43f2-9a22-443ffb6b919c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:15.771657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:15.775407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:15.779378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:15.783030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:15.784110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:15.786199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:15.867286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 820/1614] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:15.872125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:15.895608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eaaff-84dc-43df-b4ae-9a63bcf6d970 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:16.179946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:16.183184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:16.186566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:16.186990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:16.190425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:16.205686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:16.248595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 795/1615] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:15 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:16.249426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:16.267455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd4b3-3826-4a5f-b846-611e79a95729 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:16.293237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:16.298169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:16.299421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:16.303243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:16.304659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:16.306427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:16.342265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 821/1616] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:16.346523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:16.359286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dc658-2533-4858-9a27-c472fdf72480 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:16.379490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:16.380114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:16.380400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:16.380677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:16.381325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:16.383118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899974-14cf-4559-ad93-00d81e235518 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:16.415699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 796/1617] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:16.419688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:16.436413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6e73-c330-417e-9491-407a40b79ed1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:16.451782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:16.452755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:16.453364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:16.453875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] PATH_INFO: `/v3/projects/30277d14a256432d8cb2385cc0cdec10/users/206dd530960a4006848b99f0419d8ffd/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:16.509677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30277d14a256432d8cb2385cc0cdec10, user_id=206dd530960a4006848b99f0419d8ffd, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:16.513760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:16.581989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 822/1618] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:16 2022] PUT /identity/v3/projects/30277d14a256432d8cb2385cc0cdec10/users/206dd530960a4006848b99f0419d8ffd/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:16.583971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:16.584262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:16.584546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:16.593702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:16.677650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] MFA Rules not processed for user `206dd530960a4006848b99f0419d8ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:16.678917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:16.872919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 797/1619] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:16.877893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.033063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc011976-f426-4db1-9d2f-3a42c10e2931 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.049143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.049934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.050322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.050714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.051495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.061702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.072035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:17.152343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.161675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 823/1620] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:16 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:17.162227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.174013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:17.177682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8911a7-3ee4-4cfd-959b-a50760afa1c8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.304998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.307375 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.307859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.308435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.309379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.318508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.330960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d74231-ee55-4ced-a55b-b8a62499df02 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.338896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.339819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.340246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.340886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] PATH_INFO: `/v3/users/79d6e8b14ec84b95be30a59c777ff5e2` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.342198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d6e8b14ec84b95be30a59c777ff5e2)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.345748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.370832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 798/1621] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:17 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:17.372051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.395712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953137b-57ac-4b71-99e9-9ae80b64513c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.408037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.410181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.410616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.411186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.417760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.419852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.450675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 799/1622] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:17.452173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.456833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d6e8b14ec84b95be30a59c777ff5e2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:17.457783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d6e8b14ec84b95be30a59c777ff5e2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:17.469474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d6e8b14ec84b95be30a59c777ff5e2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:17.489998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b112a1-56df-4d21-9180-9dfbe5da0fe4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.497044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d6e8b14ec84b95be30a59c777ff5e2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:17.501868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.502884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.503488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.504052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.505068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.507420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.521156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f8789f-66d4-456b-8524-61451c550f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d6e8b14ec84b95be30a59c777ff5e2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:17.537097 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 824/1623] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:17 2022] DELETE /identity/v3/users/79d6e8b14ec84b95be30a59c777ff5e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:17.542655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 800/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:17.544016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.544649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.545744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.546457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.548652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:17.568353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3930-2592-4a22-8458-7a1c5f16ca03 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:17.614980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:17.619176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:17.673913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:17.674818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.675146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.675495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] PATH_INFO: `/v3/projects/5898e92b8aa4426f81b59b5340fa7555/users/dc50d25ba671463aa5ebe02e351b6222/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.683383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:17.712408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5898e92b8aa4426f81b59b5340fa7555, user_id=dc50d25ba671463aa5ebe02e351b6222, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:17.719829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a352db-3979-461c-b890-5834e2433329 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:17.759987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 825/1625] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:17.780964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 801/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:17 2022] PUT /identity/v3/projects/5898e92b8aa4426f81b59b5340fa7555/users/dc50d25ba671463aa5ebe02e351b6222/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:17.782584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:17.783859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:17.784346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:17.784836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:17.785382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:17.813813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:17.851289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] MFA Rules not processed for user `dc50d25ba671463aa5ebe02e351b6222`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:17.852904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:17.940301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f14f-aab6-4853-a99b-b7c9cc26d2b2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.020834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 802/1627] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:18.022136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.136199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.136946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.137228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.137501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.174134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b85580-9420-4958-9dcc-d06308a3c753 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.182760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.183830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.184315 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.184808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.186159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.188916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.259243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 803/1628] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:18.274127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.290622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.292668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.316790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 826/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:18.418152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:18.428637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b70b3c-4a27-462a-be56-93903682272f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.439994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.440637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.440917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.441190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.442107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.443886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.495119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 804/1630] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:18 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:18.500777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.513054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a5f8-63ff-47e1-a579-bb671ae6e544 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.518959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.519780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.519911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.520173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.521232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.522980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.553496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.565081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 827/1631] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:18.576385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de226a-abc4-4879-a31f-cd053f8edbe4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.589670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.590391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.590672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.590946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] PATH_INFO: `/v3/projects/58c15e640d794c309e94aab69ef492af/users/e1297679b04141099488afbabffa5363/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.610726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c15e640d794c309e94aab69ef492af, user_id=e1297679b04141099488afbabffa5363, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.613634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.663889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 805/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:18 2022] PUT /identity/v3/projects/58c15e640d794c309e94aab69ef492af/users/e1297679b04141099488afbabffa5363/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:18.665322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.678236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b8db-8f28-4b21-9dce-37764e5ce4eb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.825074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.826779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.828664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.829153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.830013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.835184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8a915-5119-4acd-8f95-6a0838dc1bdd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.841840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:18.869210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 828/1633] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:18.869401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:18.889849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa90a29-5f85-495b-b378-6a88fcaf5fd4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:18.903867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:18.905076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.905816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.906301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] PATH_INFO: `/v3/projects/58c15e640d794c309e94aab69ef492af/users/e1297679b04141099488afbabffa5363/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:18.909305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c15e640d794c309e94aab69ef492af, user_id=e1297679b04141099488afbabffa5363, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:18.912732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:18.983100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 806/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:18 2022] PUT /identity/v3/projects/58c15e640d794c309e94aab69ef492af/users/e1297679b04141099488afbabffa5363/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:18.986084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:18.986608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:18.986983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:19.056487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] MFA Rules not processed for user `e1297679b04141099488afbabffa5363`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:19.058257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.273098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:19.273581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 829/1635] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:19.275410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.415858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:19.418103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.501794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7866a-fc97-4a4a-8f2f-e4041b3776b8 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:19.519118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:19.520812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:19.521850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:19.522293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:19.527153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.619374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8ca4f-ad0d-4cdc-a099-69dc197c8185 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:19.627947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:19.628864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:19.628864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:19.629192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] PATH_INFO: `/v3/projects/cfe45d709cff465cae4149d1de99d43a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:19.630274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe45d709cff465cae4149d1de99d43a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:19.632701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:19.649005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:19.650908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282557cd-5953-433d-909c-24e0528949b2 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:19.693123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 807/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:19.727929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe45d709cff465cae4149d1de99d43a', 'request_id': 'req-318812ae-28e1-4458-93a1-d8a4cc006560'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:19.745090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe45d709cff465cae4149d1de99d43a', 'request_id': 'req-318812ae-28e1-4458-93a1-d8a4cc006560'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:19.753984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe45d709cff465cae4149d1de99d43a', 'request_id': 'req-318812ae-28e1-4458-93a1-d8a4cc006560'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:19.761261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:19.761742 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:19.762209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:19.764616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 808/1637] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:09:19.783913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] The token cache is being invalidate because project cfe45d709cff465cae4149d1de99d43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:19.784197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:19.784880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-318812ae-28e1-4458-93a1-d8a4cc006560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:19.786514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 830/1638] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:19 2022] DELETE /identity/v3/projects/cfe45d709cff465cae4149d1de99d43a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:19.790684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:19.793080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.812474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:19.812972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:19.813196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:19.857735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:19.860318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:19.883695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:20.010271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f5f7-2b45-4dd9-8e16-c1b9c3e63c33 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:20.018782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:20.019939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.020378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.020787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] PATH_INFO: `/v3/users/f82aa437d67d4f70b3126dca7d046035` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.023099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82aa437d67d4f70b3126dca7d046035)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:20.023791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 831/1639] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:09:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:20.024719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:20.025761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:20.026266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:20.041855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:20.043120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9db721-51f0-459c-a7d3-d31152d4bd37 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:20.065797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:20.067854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.069012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.069398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] PATH_INFO: `/v3/users/e9794dc24e24452294f5e04d0fba042e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.072635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9794dc24e24452294f5e04d0fba042e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:20.078588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:20.136035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82aa437d67d4f70b3126dca7d046035'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.151932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82aa437d67d4f70b3126dca7d046035'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.166469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82aa437d67d4f70b3126dca7d046035'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.181566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9794dc24e24452294f5e04d0fba042e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.182165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9794dc24e24452294f5e04d0fba042e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.202203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9794dc24e24452294f5e04d0fba042e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.208629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82aa437d67d4f70b3126dca7d046035'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.213109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-44344152-aadf-4e81-bd38-87e623904617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82aa437d67d4f70b3126dca7d046035'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.226384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 809/1640] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:19 2022] DELETE /identity/v3/users/f82aa437d67d4f70b3126dca7d046035 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:20.227780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ea02-dcad-47b4-85be-250ba74d5d06 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.228069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ea02-dcad-47b4-85be-250ba74d5d06 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.228339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ea02-dcad-47b4-85be-250ba74d5d06 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.230135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 810/1641] 10.222.0.20 () {54 vars in 961 bytes} [Sun Oct 23 00:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:09:20.239912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9794dc24e24452294f5e04d0fba042e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.240610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.240895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.241179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.254949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9794dc24e24452294f5e04d0fba042e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.267295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 832/1642] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:20 2022] DELETE /identity/v3/users/e9794dc24e24452294f5e04d0fba042e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:20.287973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] MFA Rules not processed for user `f066868b0a2c422590c58d763734380f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:20.289724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:20.535446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 811/1643] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Oct 23 00:09:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:20.547120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:20.563741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2aab-7ad1-4fd7-b2bc-f8908c34f42c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:20.575387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:20.576095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.576609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.576961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.580064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:20.597635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:20.599471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:20.626527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 833/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:20.711264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:20.712668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:20.874130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d5a6-9a48-456d-a3cc-0c6290271144 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:20.881013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:20.881682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:20.882066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:20.882345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] PATH_INFO: `/v3/projects/864af6afedd94073aa6cb2c197509210` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:20.883733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=864af6afedd94073aa6cb2c197509210)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:20.887031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:20.926166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:20.962519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864af6afedd94073aa6cb2c197509210', 'request_id': 'req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.967933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:20.970574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:20.974016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864af6afedd94073aa6cb2c197509210', 'request_id': 'req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.986304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864af6afedd94073aa6cb2c197509210', 'request_id': 'req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:20.990784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800ae-066c-4bf9-9797-9d7590c66206 service placement] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.017607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] The token cache is being invalidate because project 864af6afedd94073aa6cb2c197509210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:21.017770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.018473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a365fe35-4f43-45de-a6f8-7069bc6bb7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.023408 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 812/1645] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:20 2022] DELETE /identity/v3/projects/864af6afedd94073aa6cb2c197509210 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:21.025433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d74b-05d5-4791-a692-b6d7aa0aab9c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.025603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d74b-05d5-4791-a692-b6d7aa0aab9c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.026328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d74b-05d5-4791-a692-b6d7aa0aab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.053522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c020d74b-05d5-4791-a692-b6d7aa0aab9c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:21.054839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c020d74b-05d5-4791-a692-b6d7aa0aab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.069748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.069960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.070329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.070699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] PATH_INFO: `/v3/projects/c9f0f43cba774589863bba35f9a03459` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.072025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f0f43cba774589863bba35f9a03459)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.074848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.089018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:21.139276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 813/1646] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:21.147119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.147449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.147684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.155854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f0f43cba774589863bba35f9a03459', 'request_id': 'req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.163742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f0f43cba774589863bba35f9a03459', 'request_id': 'req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.168280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:21.169586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.170629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f0f43cba774589863bba35f9a03459', 'request_id': 'req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.189113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] The token cache is being invalidate because project c9f0f43cba774589863bba35f9a03459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:21.189324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.189853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-56d292c6-ece6-4feb-ac0c-e8d7a85bec10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:21.192135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 834/1647] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:20 2022] DELETE /identity/v3/projects/c9f0f43cba774589863bba35f9a03459 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:21.199270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70d36-5f42-4903-97ad-97af449ae580 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.200554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70d36-5f42-4903-97ad-97af449ae580 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.202272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70d36-5f42-4903-97ad-97af449ae580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.233066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0eb70d36-5f42-4903-97ad-97af449ae580 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:21.235389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0eb70d36-5f42-4903-97ad-97af449ae580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.247016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 814/1648] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:21.251285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.263240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34b2d9-26df-400f-abda-73bade9183cc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.270757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.271642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.271996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.272341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.273070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:21.273444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.275161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.292564 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 815/1649] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:21.293537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.306546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66348b-0fac-4a94-843b-521e7b6a1aac admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.311766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.312455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.312835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.313708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.314418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.316444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.317513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 835/1650] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:21.325483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173018-113c-4978-8bb4-264f7167d861 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.325762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173018-113c-4978-8bb4-264f7167d861 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.326037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173018-113c-4978-8bb4-264f7167d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.352840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-db173018-113c-4978-8bb4-264f7167d861 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:21.353861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 816/1651] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:21.354041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-db173018-113c-4978-8bb4-264f7167d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.357688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.378773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:21.432964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 836/1652] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:21.435695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3bd9-1795-4c3f-8d89-ec164af5ceab admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.437063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173018-113c-4978-8bb4-264f7167d861 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.441863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.442934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.444071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.444553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.445453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.447610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.449165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173018-113c-4978-8bb4-264f7167d861 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.454134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.454833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.455212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.455583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.456295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:21.456664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.458400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.472972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 837/1653] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:09:21.474985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 817/1654] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/users => generated 278 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:21.481088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.481372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.495344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54348dbd-a800-46b2-b929-7dc907acbfdd admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.496709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b8de-1d7b-463c-bc47-512ae4fcef32 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.500791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.501851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.502318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.502821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.503583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.506268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.506909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.508065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.508351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.508632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.510098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.513314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.545865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 838/1655] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:21.546849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.559058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20750a25-9915-4244-9840-242391c39e21 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.565074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.565737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.566020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.566291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.566954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.568620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.574313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 818/1656] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:21.575824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.582317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 839/1657] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:21.586616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.595429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:21.601596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a1a2-f673-4e8f-b46c-04fbe4c24e99 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.667695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f8c1f-0c68-434b-9079-297973834ee2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.672741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.673711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.674087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.674455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.675213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.677842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.722442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 819/1658] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:21.724002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.736135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.736820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.737277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.737411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] PATH_INFO: `/v3/projects/4f298fb973aa4069aa84adc2c11fa2c2/users/f0ba59e81dd74d028cda69e77d67ab5b/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.752528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d112f-336f-498c-b0a7-f8b1c0671b24 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.760737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.761548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.761828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.762093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.762771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.764594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.780446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 820/1659] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:21.784356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f298fb973aa4069aa84adc2c11fa2c2, user_id=f0ba59e81dd74d028cda69e77d67ab5b, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.785108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.785993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.788477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.802114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 840/1660] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:21 2022] PUT /identity/v3/projects/4f298fb973aa4069aa84adc2c11fa2c2/users/f0ba59e81dd74d028cda69e77d67ab5b/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:21.802932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:21.865474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eaf8-5785-4099-a4c9-1f3f4bc6896c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.883940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:21.892653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473409b-ca5b-4527-9491-40cf33d224ac admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:21.898029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.898933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.899707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.900206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.901166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:21.911367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b544-3ac1-4c9c-bb4e-c9728b019362 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:21.931800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 841/1661] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:21.933601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.934768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.935322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.941864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:21.942490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:21.942771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:21.943122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:21.944916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:21.995402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] MFA Rules not processed for user `f0ba59e81dd74d028cda69e77d67ab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:21.997068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:22.038646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.039937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.052333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 821/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:22.053029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.070196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45140a-8a91-415f-b116-44fd3c5e9bab service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.077120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.078283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.079182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.079467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] PATH_INFO: `/v3/projects/b1cd501cbe3444be84f9c56380ae3f20/users/61758703c8e9496f9d4cc1ed8665cf2a/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.113457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cd501cbe3444be84f9c56380ae3f20, user_id=61758703c8e9496f9d4cc1ed8665cf2a, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.116498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be384efa-9301-4e4c-b2e5-c0ad5e58e0bf admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.124769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 842/1663] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:22.143200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.146846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 822/1664] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:22 2022] PUT /identity/v3/projects/b1cd501cbe3444be84f9c56380ae3f20/users/61758703c8e9496f9d4cc1ed8665cf2a/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:22.154998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea0bcf-263f-425c-98f6-b9b030d6dece None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.158508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.158957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.159397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.167979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:22.211303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] MFA Rules not processed for user `61758703c8e9496f9d4cc1ed8665cf2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:22.212583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:22.264643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.268692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.269223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.269505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.270155 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.274615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.322625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 823/1665] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:22.327431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.342520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 843/1666] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/projects => generated 357 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:22.342775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf2fa-8557-4e48-9349-1b0a16d6e213 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.345084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.395841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:22.427769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.428488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.428835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.429285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.431338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.432364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.449262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999d28-05e1-4121-bb59-04402bd8fc00 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.456218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.456848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.457131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.457631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.458513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.467014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.474606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 824/1667] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:22.481626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.513690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 844/1668] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:22.517825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.531021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89e8d-2ce4-4830-b1ca-1fef089ab4f8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.575842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea030-b426-4cf7-adaa-e2ef219c55d3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.585107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.585847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.586947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.587126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.588044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.591555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.623731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 825/1669] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:22.629262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.641168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45424-fe37-434f-a297-9165ce2c6631 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.649740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.650491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.650837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.651206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.651916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.653641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.661591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.663258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.663762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.664298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.665349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.668950 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.673336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 826/1670] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:22.677310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.688188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 845/1671] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:22.693183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.694177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c1f3-ac65-4265-a961-c0a306e75c40 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.707485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.708144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.708504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.708823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.709503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.711059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.711909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19de2-c51d-4044-b196-4c0afce64eba admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.718700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.719877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.720330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.720750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] PATH_INFO: `/v3/projects/04d0cfd082644d32a1003ddc8f274efc/users/6a0037c01d39476f8bd75eba75c4cf6e/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.730271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 827/1672] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:22.744141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d0cfd082644d32a1003ddc8f274efc, user_id=6a0037c01d39476f8bd75eba75c4cf6e, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.747317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.748086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.767596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:22.768478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddf0c-615e-48f9-b8d7-9e286e3f8b82 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.781799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 846/1673] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:22 2022] PUT /identity/v3/projects/04d0cfd082644d32a1003ddc8f274efc/users/6a0037c01d39476f8bd75eba75c4cf6e/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:22.783614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:22.858386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:22.859216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.859563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.860436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] PATH_INFO: `/v3/projects/c96f6f76d0cb42c5ac5d1dcfe1bdd9b1/users/94fbfd13f65b4c1d9fa966d8198d67aa/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.878609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96f6f76d0cb42c5ac5d1dcfe1bdd9b1, user_id=94fbfd13f65b4c1d9fa966d8198d67aa, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:22.881439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e99c-e228-47f6-859c-ae200876b193 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:22.904464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 828/1674] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:22 2022] PUT /identity/v3/projects/c96f6f76d0cb42c5ac5d1dcfe1bdd9b1/users/94fbfd13f65b4c1d9fa966d8198d67aa/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:22.916371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:22.916653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:22.916933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:22.921828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c803cc-c7d1-4f7a-90d4-c8c44ea959b7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:22.949750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:22.958585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] MFA Rules not processed for user `94fbfd13f65b4c1d9fa966d8198d67aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:22.961718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:23.024417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.025304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.025780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.026161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.026874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.029550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.048520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 847/1675] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:23.049574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.062529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426141-dd73-4d38-a152-4e30891c7eb2 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.070595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.071274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.071558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.071836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] PATH_INFO: `/v3/projects/04d0cfd082644d32a1003ddc8f274efc/users/6a0037c01d39476f8bd75eba75c4cf6e/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.073776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d0cfd082644d32a1003ddc8f274efc, user_id=6a0037c01d39476f8bd75eba75c4cf6e, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.076448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.079555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 829/1676] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:23.083857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.088750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 848/1677] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:23 2022] PUT /identity/v3/projects/04d0cfd082644d32a1003ddc8f274efc/users/6a0037c01d39476f8bd75eba75c4cf6e/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:23.096718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.105629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c755cb-cc5f-4215-9de5-75ed6265ffab None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.178568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0189a-fcc4-4aaf-90dd-67870ce19ae5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.185638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.186406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.186572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.186878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.187280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.187671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.188706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.189211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.189971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:23.190731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.192834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc5886-c3a0-4e08-9836-7d9ac52ee477 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.246199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 830/1678] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:23 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:23.247704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.248068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.248333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.264769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:23.292676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] MFA Rules not processed for user `6a0037c01d39476f8bd75eba75c4cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:23.294061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:23.301092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.303145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.336561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 849/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:23.340961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.373203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf9a7e-a412-4cd0-9d6a-c1334eb828c3 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.403712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 831/1680] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:23.417313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.420053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:23.471774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:23.497224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.498019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.498658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.499061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.499966 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.502064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.537455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 850/1681] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:23 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:23.547779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.569369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d59e-bc64-4273-ad7b-955df4948f11 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.573052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35c3e-3ebe-467d-a87d-9528a5396d19 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.576221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.576917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.577387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.577832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.577934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.579140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.579403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.579649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.579895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.581684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.591399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.593002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.603607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 851/1682] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:23.604980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 832/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:23.620104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.639377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53a00-31a7-41ab-8084-9fb9b89941b6 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.645269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.646146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.646733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.647191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] PATH_INFO: `/v3/projects/501e877545b64843b022fa28cfa97a4e/users/60033fe6967b41cfbd736852a1f7311c/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.667358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=501e877545b64843b022fa28cfa97a4e, user_id=60033fe6967b41cfbd736852a1f7311c, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.670776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.701638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 852/1684] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:23 2022] PUT /identity/v3/projects/501e877545b64843b022fa28cfa97a4e/users/60033fe6967b41cfbd736852a1f7311c/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:23.705085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.707313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.726135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e86f-bb10-4ef0-a743-b9fde3dd4351 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.794570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d78910-7433-4d68-b26d-c65b1b04bcbf admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.797688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.798629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.798853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.798962 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.799158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.799506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.799789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.799890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.800060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.801433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.813687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 833/1685] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:09:23.817434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:23.827691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f7dcf-e2f8-40bc-bc4a-d713d3453927 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:23.836493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:23.837853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.838141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.838421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] PATH_INFO: `/v3/projects/501e877545b64843b022fa28cfa97a4e/users/60033fe6967b41cfbd736852a1f7311c/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.841480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] RBAC: Authorizing `identity:create_grant(project_id=501e877545b64843b022fa28cfa97a4e, user_id=60033fe6967b41cfbd736852a1f7311c, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.844686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06642-4e19-438c-bbbd-88248f32144a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.869112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 834/1686] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:23 2022] PUT /identity/v3/projects/501e877545b64843b022fa28cfa97a4e/users/60033fe6967b41cfbd736852a1f7311c/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:23.871144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:23.871529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:23.871848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:23.872473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:23.879934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:23.882405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:23.893724 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 853/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:23.910625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] MFA Rules not processed for user `60033fe6967b41cfbd736852a1f7311c`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:23.911933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:24.010461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 835/1688] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:24.018777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:24.028389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0b4d-9d9f-4449-8868-eee6d5d4cd86 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:24.113867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:24.114511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:24.114790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:24.115063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:24.183549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:24.185069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:24.196877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 854/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:25.785714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:25.795898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0f74-eb74-40c7-9db3-3db1052cc724 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:25.802211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:25.803969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:25.805433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:25.805789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:25.831823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:25.914303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:25.916031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:25.930206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 836/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:26.920710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:26.929938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495ad83-0506-4964-b9ed-dbb61b5a0969 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:26.934202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:26.935007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:26.935364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:26.935639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:26.974567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:26.979589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba88b9-e54c-4d7d-bf7e-894842683b30 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:26.995836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 855/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:28.100104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:28.100104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:28.213704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67452-a6a8-43b7-b624-d6fd0ec31066 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:28.219165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:28.220146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:28.220598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:28.221023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] PATH_INFO: `/v3/users/206dd530960a4006848b99f0419d8ffd` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:28.222334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=206dd530960a4006848b99f0419d8ffd)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:28.226132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:28.367924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206dd530960a4006848b99f0419d8ffd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:28.382521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206dd530960a4006848b99f0419d8ffd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:28.413106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206dd530960a4006848b99f0419d8ffd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:28.429346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206dd530960a4006848b99f0419d8ffd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:28.430380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206dd530960a4006848b99f0419d8ffd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:28.439136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 837/1692] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:28 2022] DELETE /identity/v3/users/206dd530960a4006848b99f0419d8ffd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:28.442893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05cc4-40cb-440b-974f-609712005986 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:28.443947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05cc4-40cb-440b-974f-609712005986 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:28.444576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05cc4-40cb-440b-974f-609712005986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:28.471481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e4c05cc4-40cb-440b-974f-609712005986 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:28.472846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e4c05cc4-40cb-440b-974f-609712005986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:28.588970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 856/1693] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:28.600152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:28.601693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:28.696494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:28.727322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc866a-453e-4602-bff0-e98a0935af30 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:28.741202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:28.741900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:28.742188 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:28.742470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:28.766169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:28.767748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:28.782393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 838/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:29.096613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:29.097040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:29.097436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:29.102550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:29.104338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:29.118559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] MFA Rules not processed for user `4a4c9498d13d451a80522437aff25237`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:29.119913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:29.129273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca7bf-c61d-4b99-88d1-e7333f623b62 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:29.135764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:29.136598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:29.136888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:29.137402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] PATH_INFO: `/v3/projects/30277d14a256432d8cb2385cc0cdec10` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:29.138888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30277d14a256432d8cb2385cc0cdec10)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:29.142313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:29.150374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:29.183902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 857/1695] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:29.195910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30277d14a256432d8cb2385cc0cdec10', 'request_id': 'req-3a3bbbb3-afb6-4572-a0be-01e129188e60'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.204063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30277d14a256432d8cb2385cc0cdec10', 'request_id': 'req-3a3bbbb3-afb6-4572-a0be-01e129188e60'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.210166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30277d14a256432d8cb2385cc0cdec10', 'request_id': 'req-3a3bbbb3-afb6-4572-a0be-01e129188e60'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.225919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] The token cache is being invalidate because project 30277d14a256432d8cb2385cc0cdec10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:29.226283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.226994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.228604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 839/1696] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:29 2022] DELETE /identity/v3/projects/30277d14a256432d8cb2385cc0cdec10 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:29.233662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:29.245326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cca5d-4cc3-4fdb-b090-67d482a8d922 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:29.305281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:29.305906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:29.306183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:29.306450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] PATH_INFO: `/v3/users/dc50d25ba671463aa5ebe02e351b6222` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:29.307593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc50d25ba671463aa5ebe02e351b6222)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:29.309477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:29.356531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc50d25ba671463aa5ebe02e351b6222'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.357198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc50d25ba671463aa5ebe02e351b6222'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.365792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc50d25ba671463aa5ebe02e351b6222'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.378135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc50d25ba671463aa5ebe02e351b6222'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.385676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc50d25ba671463aa5ebe02e351b6222'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.392378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 858/1697] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:29 2022] DELETE /identity/v3/users/dc50d25ba671463aa5ebe02e351b6222 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:29.756248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:29.762648 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:29.793758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bbbb3-afb6-4572-a0be-01e129188e60 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:29.886532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:29.887760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:29.888333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:29.889846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] PATH_INFO: `/v3/projects/5898e92b8aa4426f81b59b5340fa7555` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:29.891826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5898e92b8aa4426f81b59b5340fa7555)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:29.894788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:29.961727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5898e92b8aa4426f81b59b5340fa7555', 'request_id': 'req-00e343cf-6f70-49df-b185-c3def29f7b18'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.975426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5898e92b8aa4426f81b59b5340fa7555', 'request_id': 'req-00e343cf-6f70-49df-b185-c3def29f7b18'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.984070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5898e92b8aa4426f81b59b5340fa7555', 'request_id': 'req-00e343cf-6f70-49df-b185-c3def29f7b18'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:29.994473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:30.010746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] The token cache is being invalidate because project 5898e92b8aa4426f81b59b5340fa7555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:30.013643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.015008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.019801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 840/1698] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:29 2022] DELETE /identity/v3/projects/5898e92b8aa4426f81b59b5340fa7555 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:30.024245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:30.026077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:30.057701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5c46-3172-4ae9-9cad-719db99c8ef8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:30.118707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:30.129386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:30.130248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.130514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.131122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] PATH_INFO: `/v3/users/e1297679b04141099488afbabffa5363` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.132136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1297679b04141099488afbabffa5363)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:30.134974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:30.194549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1297679b04141099488afbabffa5363'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.195278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1297679b04141099488afbabffa5363'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.209510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1297679b04141099488afbabffa5363'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.225459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1297679b04141099488afbabffa5363'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.235671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a51664da-0e0f-45b3-8d69-2bf3b0e53ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1297679b04141099488afbabffa5363'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.242866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 859/1699] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:30 2022] DELETE /identity/v3/users/e1297679b04141099488afbabffa5363 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:30.552347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:30.553782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:30.570362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e343cf-6f70-49df-b185-c3def29f7b18 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:30.632498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:30.633247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.633523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.633793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] PATH_INFO: `/v3/projects/58c15e640d794c309e94aab69ef492af` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.634909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c15e640d794c309e94aab69ef492af)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:30.636854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:30.688387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c15e640d794c309e94aab69ef492af', 'request_id': 'req-138c0b1c-e36c-49c0-9933-807668967261'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.695845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c15e640d794c309e94aab69ef492af', 'request_id': 'req-138c0b1c-e36c-49c0-9933-807668967261'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.701665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c15e640d794c309e94aab69ef492af', 'request_id': 'req-138c0b1c-e36c-49c0-9933-807668967261'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.713021 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] The token cache is being invalidate because project 58c15e640d794c309e94aab69ef492af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:30.713308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.713981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-138c0b1c-e36c-49c0-9933-807668967261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:30.715801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 841/1700] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:30 2022] DELETE /identity/v3/projects/58c15e640d794c309e94aab69ef492af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:30.720994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.721282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.721559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.743614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:30.744821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:30.811902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 860/1701] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:30.819690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.819982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.820461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.841781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:30.843345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:30.852658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 842/1702] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:30.863271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:30.873114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ec175-1e35-4e10-9c80-6bc44e1e49b0 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:30.877840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:30.878440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.878716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.878986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.879655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:30.879955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:30.881523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:30.895120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 861/1703] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:30.897387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:30.907308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d3c22-b71c-4d46-a220-d5c985775171 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:30.912013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:30.912672 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:30.913020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:30.913350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:30.914049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:30.916030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:30.945233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 843/1704] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:30 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:30.949266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:30.959852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577f77-bb7e-476f-ae9b-9d2473e2b401 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.017674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.018278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.018556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.018826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.019481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.021359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.030231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:31.042613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 862/1705] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:30 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:31.046601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.059669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f9dbe-9173-4b7c-a6d2-d39660f2b33a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.064881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.065480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.065756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.067162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.067885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.069478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.082160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 844/1706] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:31.084053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.094200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f8c0-fdc7-4824-a353-0898a5fbdbf3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.098942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.099582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.099982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.100259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.100899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.102512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d37004-b968-4c9b-83cb-e1503873ce41 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.115279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 863/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:31.119492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.130236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a9fb-c214-4414-bdf7-49584014f2df admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.135143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.135878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.136156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.136447 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] PATH_INFO: `/v3/projects/6080cd7ecd6f4121bed52bd8a10ed153/users/429ec3ab51df4072a06baaea8d9dd20c/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.162554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6080cd7ecd6f4121bed52bd8a10ed153, user_id=429ec3ab51df4072a06baaea8d9dd20c, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.165717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.182348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 845/1708] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:31 2022] PUT /identity/v3/projects/6080cd7ecd6f4121bed52bd8a10ed153/users/429ec3ab51df4072a06baaea8d9dd20c/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:31.194130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.194416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.194687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.225380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] MFA Rules not processed for user `429ec3ab51df4072a06baaea8d9dd20c`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:31.226935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.348108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 864/1709] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:31.364696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.367049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.387351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.388813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.425704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:31.489411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e0f71-a6bb-40a8-a4fc-dc7b173d2a6a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.497905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.498499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41784123-0bf8-4b85-835c-9f60ebf70088 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.498657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.498888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.499182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] PATH_INFO: `/v3/users/61758703c8e9496f9d4cc1ed8665cf2a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.500641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61758703c8e9496f9d4cc1ed8665cf2a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.503397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.503550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.504162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.504446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.504722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.516775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.518218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255e29-13d6-4701-b4d8-bedc20468e8b service glance] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.528429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 846/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:31.577961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61758703c8e9496f9d4cc1ed8665cf2a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:31.579726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61758703c8e9496f9d4cc1ed8665cf2a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:31.590140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61758703c8e9496f9d4cc1ed8665cf2a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:31.634568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61758703c8e9496f9d4cc1ed8665cf2a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:31.638340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:31.657522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b4bef8f4-10ba-4e66-b410-703fdc8e3100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61758703c8e9496f9d4cc1ed8665cf2a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:31.679252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 865/1711] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:31 2022] DELETE /identity/v3/users/61758703c8e9496f9d4cc1ed8665cf2a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:31.680997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.681472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.681941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.684607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.685054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.685477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.713431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:31.713636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:31.715147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.715506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.798696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 866/1712] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:31.809315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.811065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.818323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 847/1713] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:09:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:31.833336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:31.835161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:31.926819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ebc4-fbaa-4432-ae63-490a32891b15 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.933835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.935039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.935687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.936278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.954823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:31.958474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:31.965890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba3448-e735-4c53-859e-6456e15bff9c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:31.977105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:31.978097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:31.978567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:31.978683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 867/1714] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:31.978963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:31.997432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:32.000449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:32.030660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 848/1715] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:09:32.552160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:32.554290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:32.579386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c63b7-8606-4474-8b63-c7486da69d5b service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:32.596578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:32.597235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:32.597510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:32.597783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] PATH_INFO: `/v3/projects/b1cd501cbe3444be84f9c56380ae3f20` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:32.609317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1cd501cbe3444be84f9c56380ae3f20)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:32.612364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:32.792740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1cd501cbe3444be84f9c56380ae3f20', 'request_id': 'req-d8c5f5de-1002-445e-a061-a9818177f310'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:32.817018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1cd501cbe3444be84f9c56380ae3f20', 'request_id': 'req-d8c5f5de-1002-445e-a061-a9818177f310'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:32.834998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1cd501cbe3444be84f9c56380ae3f20', 'request_id': 'req-d8c5f5de-1002-445e-a061-a9818177f310'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:32.870670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] The token cache is being invalidate because project b1cd501cbe3444be84f9c56380ae3f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:32.876152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:32.877392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:32.882183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 868/1716] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:32 2022] DELETE /identity/v3/projects/b1cd501cbe3444be84f9c56380ae3f20 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:32.885872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:32.908929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1d835-66ba-4df1-bd6e-9f3746ec6ac7 service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:33.020519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:33.021443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:33.021718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:33.022135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] PATH_INFO: `/v3/users/94fbfd13f65b4c1d9fa966d8198d67aa` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:33.023530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fbfd13f65b4c1d9fa966d8198d67aa)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:33.025611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:33.029534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:33.123668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fbfd13f65b4c1d9fa966d8198d67aa'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:33.144169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fbfd13f65b4c1d9fa966d8198d67aa'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:33.154574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fbfd13f65b4c1d9fa966d8198d67aa'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:33.196422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fbfd13f65b4c1d9fa966d8198d67aa'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:33.197405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fbfd13f65b4c1d9fa966d8198d67aa'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:33.204946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 849/1717] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:32 2022] DELETE /identity/v3/users/94fbfd13f65b4c1d9fa966d8198d67aa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:33.935009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:33.937447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:33.959758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f5de-1002-445e-a061-a9818177f310 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:33.995028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:34.057911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:34.059825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:34.060400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:34.060875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] PATH_INFO: `/v3/projects/c96f6f76d0cb42c5ac5d1dcfe1bdd9b1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:34.064103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96f6f76d0cb42c5ac5d1dcfe1bdd9b1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:34.076081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:34.151527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96f6f76d0cb42c5ac5d1dcfe1bdd9b1', 'request_id': 'req-4f378aab-7b56-4883-ae6a-da60509e0a47'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.159908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96f6f76d0cb42c5ac5d1dcfe1bdd9b1', 'request_id': 'req-4f378aab-7b56-4883-ae6a-da60509e0a47'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.166860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96f6f76d0cb42c5ac5d1dcfe1bdd9b1', 'request_id': 'req-4f378aab-7b56-4883-ae6a-da60509e0a47'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.181325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] The token cache is being invalidate because project c96f6f76d0cb42c5ac5d1dcfe1bdd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:34.181530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.182182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.183820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 869/1718] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:33 2022] DELETE /identity/v3/projects/c96f6f76d0cb42c5ac5d1dcfe1bdd9b1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:34.189034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:34.190775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:34.209358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b16a-7403-4ca0-b572-2dda851ac283 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:34.280489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:34.281842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:34.281980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:34.282257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] PATH_INFO: `/v3/users/60033fe6967b41cfbd736852a1f7311c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:34.283503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60033fe6967b41cfbd736852a1f7311c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:34.285466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:34.351429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60033fe6967b41cfbd736852a1f7311c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.361078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60033fe6967b41cfbd736852a1f7311c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.370783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60033fe6967b41cfbd736852a1f7311c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.402949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60033fe6967b41cfbd736852a1f7311c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.404379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-18559465-afc2-4f8e-af49-f184ead3f8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60033fe6967b41cfbd736852a1f7311c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:34.408091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:34.414974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 850/1719] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:34 2022] DELETE /identity/v3/users/60033fe6967b41cfbd736852a1f7311c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:34.825923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:34.827903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:34.871102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378aab-7b56-4883-ae6a-da60509e0a47 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.050265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.051108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.051572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.052023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] PATH_INFO: `/v3/projects/501e877545b64843b022fa28cfa97a4e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.053166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501e877545b64843b022fa28cfa97a4e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.055448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.181647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:35.200609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501e877545b64843b022fa28cfa97a4e', 'request_id': 'req-8558a9b4-33f6-47ac-9981-4e3c1db2d547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:35.208877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501e877545b64843b022fa28cfa97a4e', 'request_id': 'req-8558a9b4-33f6-47ac-9981-4e3c1db2d547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:35.216651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501e877545b64843b022fa28cfa97a4e', 'request_id': 'req-8558a9b4-33f6-47ac-9981-4e3c1db2d547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:35.237617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] The token cache is being invalidate because project 501e877545b64843b022fa28cfa97a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:35.248362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:35.248362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8558a9b4-33f6-47ac-9981-4e3c1db2d547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:35.248362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 870/1720] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:34 2022] DELETE /identity/v3/projects/501e877545b64843b022fa28cfa97a4e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:35.250690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.251569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.252011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.312162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:35.313940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:35.430208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 851/1721] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:35.434891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.435283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.435564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.459423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:35.460657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:35.469262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 871/1722] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:35.473794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.502420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a05b1-038f-4fb5-987b-cf929576e6c8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.507581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.508391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.508822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.509396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.510205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:35.510682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.512489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.542765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 852/1723] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:35.548314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.557680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6ab06-7af8-4730-8e07-48fadeb82049 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.564257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.564859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.565144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.565413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.566053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.567990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.597643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 872/1724] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:35 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:35.601956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.614383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8021f7d-65a4-4b26-8c85-cb3a7377b786 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.680701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.681433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.681708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.682019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.683229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.686838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.715028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 853/1725] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:35 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:35.721088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.733010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205c21-ebe0-493b-a22f-7d1c9d4a09ce admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.738394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.739005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.739310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.739611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.740246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.741812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.753099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 873/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:35.757268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.768435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074465f-3297-474c-ae01-f32d5eac9ca1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.774693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.775352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.775635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.776040 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.776748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.783419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025e88-3449-4c60-8273-9381e8ba0880 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.799129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 854/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:09:35.800601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:35.810898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f775-69f4-4136-8304-43da14f31373 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:35.816007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:35.816672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.816946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.817216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] PATH_INFO: `/v3/projects/65479285d15645a1ab581c3acdfdcc2b/users/8bcd24358fdc4a13b3502c3be90028b6/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.833690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65479285d15645a1ab581c3acdfdcc2b, user_id=8bcd24358fdc4a13b3502c3be90028b6, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:35.836540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:35.850527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 874/1728] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:35 2022] PUT /identity/v3/projects/65479285d15645a1ab581c3acdfdcc2b/users/8bcd24358fdc4a13b3502c3be90028b6/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:35.862462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:35.862748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:35.863028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:35.904208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] MFA Rules not processed for user `8bcd24358fdc4a13b3502c3be90028b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:35.905458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:35.971373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:35.991441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 855/1729] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:36.002788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:36.004519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:36.070762 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188902-a586-43c0-b225-ecd84d36cec3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:36.074554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:36.075204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:36.075485 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:36.075758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:36.084783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:36.086351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037e432-ca39-46ee-9ceb-2f36c7ee18c9 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:36.102497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 875/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:39.040392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:39.110902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d676-c22c-43da-950f-1eba35e76ed1 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:39.115888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:39.116529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:39.117052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:39.117333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] PATH_INFO: `/v3/users/8bcd24358fdc4a13b3502c3be90028b6` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:39.118509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcd24358fdc4a13b3502c3be90028b6)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:39.120566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:39.189942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcd24358fdc4a13b3502c3be90028b6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.201286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcd24358fdc4a13b3502c3be90028b6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.210872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcd24358fdc4a13b3502c3be90028b6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.231351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcd24358fdc4a13b3502c3be90028b6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.231351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcd24358fdc4a13b3502c3be90028b6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.231764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 856/1731] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:39 2022] DELETE /identity/v3/users/8bcd24358fdc4a13b3502c3be90028b6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:39.236701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:39.237270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:39.237507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:39.277255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:39.278985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:39.362274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 876/1732] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:39.372934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:39.374499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:39.464280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983c88-0b1a-4ab0-a3a5-1fa60cfbd94c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:39.468025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:39.469232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:39.469528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:39.469867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:39.479003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:39.480481 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82e46b-3c20-44f5-ba45-3f1a367963e7 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:39.490381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 857/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:39.835116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:39.837436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:39.859865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e23b4-33be-494d-ba29-62e160ff4e84 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:39.874505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:39.876344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:39.876650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:39.876916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] PATH_INFO: `/v3/projects/65479285d15645a1ab581c3acdfdcc2b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:39.879808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65479285d15645a1ab581c3acdfdcc2b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:39.881788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:39.918420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:39.986512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65479285d15645a1ab581c3acdfdcc2b', 'request_id': 'req-bee41ce7-f788-4849-85cb-b2dcfad7684f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:39.995677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65479285d15645a1ab581c3acdfdcc2b', 'request_id': 'req-bee41ce7-f788-4849-85cb-b2dcfad7684f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:40.004379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65479285d15645a1ab581c3acdfdcc2b', 'request_id': 'req-bee41ce7-f788-4849-85cb-b2dcfad7684f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:40.037157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] The token cache is being invalidate because project 65479285d15645a1ab581c3acdfdcc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:40.037494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:40.038240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-bee41ce7-f788-4849-85cb-b2dcfad7684f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:40.052600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.053158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.053434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.058507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 877/1734] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:39 2022] DELETE /identity/v3/projects/65479285d15645a1ab581c3acdfdcc2b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:40.101082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:40.102609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:40.131507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:40.189815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 858/1735] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:40.198431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.198713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.198989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.219847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:40.221081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:40.236245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 878/1736] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:40.240049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.250845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5770b11-35c6-488d-a0c9-65ada98d34e6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.256100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.256877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.257515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.258034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.260534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:40.260534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.265228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.277805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 859/1737] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:40.282733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.295102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a9e0-b76b-4ec8-b7ed-230a9882d3c0 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.301490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.302137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.302419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.302702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.303404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.305537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.345804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 879/1738] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:40 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:40.349847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.360715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd470ae-7126-4c66-9f42-8394940c95f1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.421384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.422394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.423026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.423430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.424174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.426746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.467363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 860/1739] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:40 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:40.471272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.482242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba8fda-1bc9-405d-9a2f-0df8323ad885 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.487637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.488266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.488552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.488823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.489473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.491103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.502897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 880/1740] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:40.506883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.518900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccddc9-7fce-4919-ac3b-00474a2eaf69 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.530912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.532245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.532875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.533530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.534407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.536387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167d704-b688-4572-a934-5da8e058d9da admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.554652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 861/1741] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:40.558880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.569909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d0f47-982b-41c7-9e43-11418cd6223c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.574670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.575349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.575625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.575897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] PATH_INFO: `/v3/projects/0468837ceda543dc97c7dd749703dc98/users/cf22bff688d24f3fb2720dd7110613d3/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.593442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0468837ceda543dc97c7dd749703dc98, user_id=cf22bff688d24f3fb2720dd7110613d3, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.596219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.608835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 881/1742] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:40 2022] PUT /identity/v3/projects/0468837ceda543dc97c7dd749703dc98/users/cf22bff688d24f3fb2720dd7110613d3/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:09:40.619662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.619942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.620214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.664916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] MFA Rules not processed for user `cf22bff688d24f3fb2720dd7110613d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:40.666378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:40.766291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 862/1743] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:40.775964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:40.778149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:40.856506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be89a3-0407-4d55-8c27-9617a9c2329b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:40.861860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:40.862746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:40.863132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:40.863462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:40.876897 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:40.878525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18ae39-7531-42b8-8094-ab3c2a10584f service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:40.903783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 882/1744] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:41.075167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:41.076840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:41.093214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:41.198153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824402-6be1-482b-bf62-2e9b41aebde7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:41.203537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:41.204193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:41.204469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:41.204738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] PATH_INFO: `/v3/users/f0ba59e81dd74d028cda69e77d67ab5b` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:41.205948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ba59e81dd74d028cda69e77d67ab5b)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:41.225080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:41.376649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ba59e81dd74d028cda69e77d67ab5b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:41.415112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ba59e81dd74d028cda69e77d67ab5b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:41.428944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ba59e81dd74d028cda69e77d67ab5b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:41.447242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ba59e81dd74d028cda69e77d67ab5b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:41.448217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ba59e81dd74d028cda69e77d67ab5b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:41.457338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 863/1745] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:41 2022] DELETE /identity/v3/users/f0ba59e81dd74d028cda69e77d67ab5b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:41.461784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:41.462286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:41.462394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:41.499139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:41.504861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:41.545294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:41.576466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 883/1746] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:41.588792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:41.590370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:41.651222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dec22-e92d-4d4e-b0e3-2fc096ed5466 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:41.654686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:41.655330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:41.655609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:41.655939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:41.665234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:41.666641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:41.677009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 864/1747] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:41.994227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:41.995718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:42.012088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8ff9e-4662-43f4-a799-3692c1b79b69 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:42.017722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:42.018442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:42.018786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:42.019159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] PATH_INFO: `/v3/projects/4f298fb973aa4069aa84adc2c11fa2c2` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:42.020622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f298fb973aa4069aa84adc2c11fa2c2)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:42.022932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:42.079357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f298fb973aa4069aa84adc2c11fa2c2', 'request_id': 'req-8def5602-27a2-41b2-a333-6555af4a65b4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.084983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f298fb973aa4069aa84adc2c11fa2c2', 'request_id': 'req-8def5602-27a2-41b2-a333-6555af4a65b4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.091431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f298fb973aa4069aa84adc2c11fa2c2', 'request_id': 'req-8def5602-27a2-41b2-a333-6555af4a65b4'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.103874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] The token cache is being invalidate because project 4f298fb973aa4069aa84adc2c11fa2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:42.104164 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.104842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.109459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 884/1748] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:41 2022] DELETE /identity/v3/projects/4f298fb973aa4069aa84adc2c11fa2c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:42.110670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:42.120434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7387d-1de7-4bff-b5ce-82ecaa70196c service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:42.157064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:42.183274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:42.183911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:42.184186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:42.184448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] PATH_INFO: `/v3/users/6a0037c01d39476f8bd75eba75c4cf6e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:42.185546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0037c01d39476f8bd75eba75c4cf6e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:42.188204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:42.243498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0037c01d39476f8bd75eba75c4cf6e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.253140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0037c01d39476f8bd75eba75c4cf6e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.261461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0037c01d39476f8bd75eba75c4cf6e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.273982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0037c01d39476f8bd75eba75c4cf6e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.274630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1332bba9-54c5-48b3-8a13-de06242571b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0037c01d39476f8bd75eba75c4cf6e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.280490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 865/1749] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:42 2022] DELETE /identity/v3/users/6a0037c01d39476f8bd75eba75c4cf6e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:42.679035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:42.680681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:42.696266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5602-27a2-41b2-a333-6555af4a65b4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:42.761952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:42.762595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:42.762870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:42.763175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] PATH_INFO: `/v3/projects/04d0cfd082644d32a1003ddc8f274efc` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:42.764391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d0cfd082644d32a1003ddc8f274efc)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:42.767560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:42.818229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d0cfd082644d32a1003ddc8f274efc', 'request_id': 'req-c89ee1e9-de36-4775-8a9d-5502ca004213'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.825117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d0cfd082644d32a1003ddc8f274efc', 'request_id': 'req-c89ee1e9-de36-4775-8a9d-5502ca004213'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.833819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d0cfd082644d32a1003ddc8f274efc', 'request_id': 'req-c89ee1e9-de36-4775-8a9d-5502ca004213'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.835664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:42.850219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] The token cache is being invalidate because project 04d0cfd082644d32a1003ddc8f274efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:42.850634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.851586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c89ee1e9-de36-4775-8a9d-5502ca004213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:42.854487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 885/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:42 2022] DELETE /identity/v3/projects/04d0cfd082644d32a1003ddc8f274efc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:42.860129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:42.860418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:42.860687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:42.884459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:42.885710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:42.975151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 866/1751] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:42.976578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:42.976860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:42.977132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.001048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:43.002812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:43.012708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 886/1752] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:43.017847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.034778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae8e3f-0122-4a04-8c7d-d2f04d56530b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.063942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.064661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.065117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.065399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.066244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:43.066726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.068667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.087133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 867/1753] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:43.090131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.101161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b8a4a-0b59-4bda-a67c-808e8df38d69 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.106274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.106991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.107357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.107517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.108235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.110151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.157942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 887/1754] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:43.162505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.176464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc2192-b540-4c4d-acf8-9e18d16dc356 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.232238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:43.254513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.255157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.255436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.255708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.256344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.258270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.285267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 868/1755] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:43.288200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.299392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0567d5-8653-4cda-a895-ad2db925ff51 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.304185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.304788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.305063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.305335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.305969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.307561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.318231 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 888/1756] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:09:43.322448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.333185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d37b-9b3f-4627-8042-cd55d2169ae2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.338610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.339276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.339562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.339852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.340511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.342098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b529-480e-4e84-874c-2d649d1d8938 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.353448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 869/1757] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:43.357784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.368021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9460-c70a-4f26-bc20-cf67d8053011 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.373259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.373953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.374236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.375222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] PATH_INFO: `/v3/projects/75a2fa4ffb3d4af4af44c3169fb3211c/users/d3c81fcb3c8e4a449a95a4c686258f44/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.391271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a2fa4ffb3d4af4af44c3169fb3211c, user_id=d3c81fcb3c8e4a449a95a4c686258f44, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.394207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.408479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 889/1758] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:43 2022] PUT /identity/v3/projects/75a2fa4ffb3d4af4af44c3169fb3211c/users/d3c81fcb3c8e4a449a95a4c686258f44/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:43.421715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.422066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.422392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.454637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] MFA Rules not processed for user `d3c81fcb3c8e4a449a95a4c686258f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:43.455811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:43.523713 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 870/1759] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:43.528316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.592066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db94bc-37d6-4dc2-91b2-dac456ca11fc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.597226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.597830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.598113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.598383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.599022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.600940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.628403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 890/1760] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:43.632541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.643438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403cddd-1fb5-4ca4-9fd0-790c451c7d08 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.710271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.711025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.711467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.711802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.712523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.714748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.748652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 871/1761] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:43.752606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.766051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4e7f-aaaf-4a25-ba6e-ea66578ffc1e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.777087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.778444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.778444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.778444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.778888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.780699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.792994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 891/1762] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:43.796863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.810471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a31c-de3e-45b2-a11f-b51ec6b36432 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.815482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.815741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.816313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.816313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] PATH_INFO: `/v3/projects/c3d1770597f647159cb52053673f1c31/users/e838d9c73ba043899cdd9d584a9c1623/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.832837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d1770597f647159cb52053673f1c31, user_id=e838d9c73ba043899cdd9d584a9c1623, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.835507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.849920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 872/1763] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:43 2022] PUT /identity/v3/projects/c3d1770597f647159cb52053673f1c31/users/e838d9c73ba043899cdd9d584a9c1623/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:43.854012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.865052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb35f9-d271-4a85-a2d1-6deea5a36658 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.923412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.924014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.924290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.924560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.925189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.926761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda96f-3e3c-4071-bb46-dc2a4398eba5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.928793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:43.940012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 892/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:43.943992 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:43.954829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9941c19-0893-4c09-8519-4fa4b15d9932 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:43.959496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:43.960095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.960374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.960646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] PATH_INFO: `/v3/projects/c3d1770597f647159cb52053673f1c31/users/e838d9c73ba043899cdd9d584a9c1623/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:43.962540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d1770597f647159cb52053673f1c31, user_id=e838d9c73ba043899cdd9d584a9c1623, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:43.965207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:43.976295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 873/1765] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:43 2022] PUT /identity/v3/projects/c3d1770597f647159cb52053673f1c31/users/e838d9c73ba043899cdd9d584a9c1623/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:43.986536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:43.986825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:43.987131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:44.016619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] MFA Rules not processed for user `e838d9c73ba043899cdd9d584a9c1623`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:44.017830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:44.086731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 893/1766] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:44.098811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:44.100645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:44.106261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:44.162625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a81aa7-d844-45ca-a03f-e254bd488882 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:44.166332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:44.166939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:44.167250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:44.167522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:44.177328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:44.178828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:44.189287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 874/1767] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:44.236518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:44.249447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4330-0033-4407-b214-9b5b4cc4065a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:44.255991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:44.256601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:44.256876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:44.257143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:44.344245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:44.347547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747440-0a5e-46e0-8085-4abd54aa5f37 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:44.361664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 894/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:48.071504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:48.138827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4d36a-9fd1-4151-adac-0a8de4ab915b service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:48.144102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:48.144833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:48.145127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:48.145397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] PATH_INFO: `/v3/users/d3c81fcb3c8e4a449a95a4c686258f44` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:48.146605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c81fcb3c8e4a449a95a4c686258f44)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:48.149084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:48.215906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c81fcb3c8e4a449a95a4c686258f44'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:48.224426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c81fcb3c8e4a449a95a4c686258f44'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:48.234774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c81fcb3c8e4a449a95a4c686258f44'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:48.254451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c81fcb3c8e4a449a95a4c686258f44'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:48.256234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c81fcb3c8e4a449a95a4c686258f44'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:48.264250 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 875/1769] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:48 2022] DELETE /identity/v3/users/d3c81fcb3c8e4a449a95a4c686258f44 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:48.269119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:48.269609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:48.269730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:48.290769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:48.292022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:48.353523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 895/1770] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:48.364624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:48.366035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:48.394927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:48.426614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260f4eb-f831-4a1b-89ec-449ad999fd18 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:48.430301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:48.430959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:48.431265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:48.431540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:48.440499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:48.441914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:48.451209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 876/1771] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:48.961561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:48.963359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:48.977476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7b372-686a-4bf2-b032-ed9824d9136e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:48.982288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:48.982952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:48.983245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:48.984392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] PATH_INFO: `/v3/projects/75a2fa4ffb3d4af4af44c3169fb3211c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:48.985246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a2fa4ffb3d4af4af44c3169fb3211c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:48.987226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:49.007224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:49.038230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a2fa4ffb3d4af4af44c3169fb3211c', 'request_id': 'req-014cc54e-e6f8-4c81-a856-569ec65333cb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.043891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a2fa4ffb3d4af4af44c3169fb3211c', 'request_id': 'req-014cc54e-e6f8-4c81-a856-569ec65333cb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.051253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a2fa4ffb3d4af4af44c3169fb3211c', 'request_id': 'req-014cc54e-e6f8-4c81-a856-569ec65333cb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.064294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] The token cache is being invalidate because project 75a2fa4ffb3d4af4af44c3169fb3211c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:49.064521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.065136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.066810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 896/1772] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:48 2022] DELETE /identity/v3/projects/75a2fa4ffb3d4af4af44c3169fb3211c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:49.070614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:49.080575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb208761-e2b2-4136-909a-35226d666569 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:49.139670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:49.140359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:49.140631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:49.141338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] PATH_INFO: `/v3/users/e838d9c73ba043899cdd9d584a9c1623` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:49.142845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e838d9c73ba043899cdd9d584a9c1623)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:49.144795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:49.192707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e838d9c73ba043899cdd9d584a9c1623'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.199700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e838d9c73ba043899cdd9d584a9c1623'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.208536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e838d9c73ba043899cdd9d584a9c1623'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.223362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e838d9c73ba043899cdd9d584a9c1623'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.224057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2901dd87-9fcc-41d9-9014-9f0c82f3a0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e838d9c73ba043899cdd9d584a9c1623'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.231012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 877/1773] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:49 2022] DELETE /identity/v3/users/e838d9c73ba043899cdd9d584a9c1623 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:49.654087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:49.655656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:49.683421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc54e-e6f8-4c81-a856-569ec65333cb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:49.780132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:49.781043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:49.781386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:49.781784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] PATH_INFO: `/v3/projects/c3d1770597f647159cb52053673f1c31` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:49.783045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d1770597f647159cb52053673f1c31)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:49.785725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:49.864007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d1770597f647159cb52053673f1c31', 'request_id': 'req-d9ae7f2b-e776-403a-bf29-36edfc9e8547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.873532 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d1770597f647159cb52053673f1c31', 'request_id': 'req-d9ae7f2b-e776-403a-bf29-36edfc9e8547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.886170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d1770597f647159cb52053673f1c31', 'request_id': 'req-d9ae7f2b-e776-403a-bf29-36edfc9e8547'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.912433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] The token cache is being invalidate because project c3d1770597f647159cb52053673f1c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:49.928264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.928786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d9ae7f2b-e776-403a-bf29-36edfc9e8547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:49.931650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 897/1774] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:49 2022] DELETE /identity/v3/projects/c3d1770597f647159cb52053673f1c31 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:49.936289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:49.937891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:49.938649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:49.961547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:49.963126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:50.039641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:50.063432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 878/1775] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:09:50.072073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.072358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.072633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.094216 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:50.095492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:50.104562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 898/1776] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:50.109536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.119533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c13f9-6158-4eff-90e8-ce4f87b2df05 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.124426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.125030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.125311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.125586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.126229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:50.126532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.128155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.139800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 879/1777] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:50.144386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.154049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c6164-be4c-41f5-87fe-15fc0c12cb77 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.159489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.160355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.161281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.161575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.162226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.164405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.192535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 899/1778] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:50.196810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.207207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cc421-9cca-4d3f-ab62-7e44329ecd46 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.276169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.276846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.277104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.277380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.278033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.280017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.333097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 880/1779] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:50.337630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.348421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59bd80-caf6-431f-a405-e7e8fdb36269 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.353408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.354032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.354310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.354629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.355236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.356932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.358194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:50.372182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 900/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:09:50.373361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.383435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b4d2a-d71a-4184-804e-3ec75b8e8021 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.388054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.388660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.388942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.389216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.389854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.391498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f664eb2-2d90-43d8-a885-8eb30ca6a1d3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.401977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 881/1781] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:50.406689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.416362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c8a6-a98c-4cfd-8e93-8ddb0052dbf8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.420844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.422037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.422318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.422589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] PATH_INFO: `/v3/projects/725b14fc948f48f89c7fe66174f75e1e/users/0e1bbb8c1c884908996623a74c11a139/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.437010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=725b14fc948f48f89c7fe66174f75e1e, user_id=0e1bbb8c1c884908996623a74c11a139, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.439677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.453262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 901/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:50 2022] PUT /identity/v3/projects/725b14fc948f48f89c7fe66174f75e1e/users/0e1bbb8c1c884908996623a74c11a139/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:50.464599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.464881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.465174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.492926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] MFA Rules not processed for user `0e1bbb8c1c884908996623a74c11a139`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:50.494124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:50.557738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 882/1783] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:50.562361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.623008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627c156-499a-4be8-9329-2104a0846c9f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.627574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.628173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.628452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.628726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.629356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.631270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.661682 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 902/1784] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:50.666159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.678718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed7e03-9963-4661-a215-ceb099617e45 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.719441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:50.739424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.740136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.740376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.750737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.751597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.753960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.781606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 883/1785] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:50 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:50.788436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.805236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6064e8-aacf-4750-b49d-7429df4e21cd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.814779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.817206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.817334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.817967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.819065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.821908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.851370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 903/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:50.851581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.871291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dfeea-a64c-4338-b7ee-b7e1034312a9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:50.871291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:50.871291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:50.871291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:50.871614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] PATH_INFO: `/v3/projects/e6547de1f523446ea79420c8e397c255/users/62141be72ccd4588b22b89507c08be66/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:50.888912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6547de1f523446ea79420c8e397c255, user_id=62141be72ccd4588b22b89507c08be66, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:50.891754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:50.907904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 884/1787] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:50 2022] PUT /identity/v3/projects/e6547de1f523446ea79420c8e397c255/users/62141be72ccd4588b22b89507c08be66/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:50.912007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:50.925500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec4d6-85d6-4dae-8f3c-ec5b35cefc25 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.032763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.033891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.034333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.034837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.036240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.038339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead97c6c-cc11-4a85-bc46-53311efce832 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.066816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 904/1788] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:51.067549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:51.080390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467c6ff-67ec-42df-bca8-59d4c21486e6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.095529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.096281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.096597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.098468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] PATH_INFO: `/v3/projects/e6547de1f523446ea79420c8e397c255/users/62141be72ccd4588b22b89507c08be66/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.101798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6547de1f523446ea79420c8e397c255, user_id=62141be72ccd4588b22b89507c08be66, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.109513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.142480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 885/1789] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:51 2022] PUT /identity/v3/projects/e6547de1f523446ea79420c8e397c255/users/62141be72ccd4588b22b89507c08be66/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:51.144945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.145663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.145861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.188755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] MFA Rules not processed for user `62141be72ccd4588b22b89507c08be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:51.190380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:51.269219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:51.340718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 905/1790] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:51.353400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:51.355221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:51.415465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35201cc-99c1-46fa-9f0c-3ba9f717d0e7 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.419142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.419708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.420032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.420251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.429778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.431216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.440616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 886/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:51.793251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:51.804159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409928-561b-4ce5-8f32-4a5978fe98a7 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.808878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62141be72ccd4588b22b89507c08be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6547de1f523446ea79420c8e397c255', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.809561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.809910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.810254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.810989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:51.811393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.813152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.825379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 906/1792] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:09:51.831998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:51.841119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6fd4-07aa-42e3-a0b1-2a45caf414d5 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.846213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62141be72ccd4588b22b89507c08be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6547de1f523446ea79420c8e397c255', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.846803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.847109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.847391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.848054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.849941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.878180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 887/1793] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:51 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:51.882012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:51.892377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2c732-8be6-4f6a-82bf-54b8a625c99c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:51.948884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62141be72ccd4588b22b89507c08be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6547de1f523446ea79420c8e397c255', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:51.949414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:51.949696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:51.949974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:51.950646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:51.950954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:51.953202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:51.969191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 907/1794] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:52.005737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:52.016858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db026cf-9c1d-4445-9d2a-3ce53b80993d tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:52.021897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62141be72ccd4588b22b89507c08be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6547de1f523446ea79420c8e397c255', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:52.022431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:52.022703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:52.022985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] PATH_INFO: `/v3/projects/4c2e225891e445f8bb0c11f37bb47b17` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:52.027868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c2e225891e445f8bb0c11f37bb47b17)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:52.029910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:52.078352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2e225891e445f8bb0c11f37bb47b17', 'request_id': 'req-63f16ff5-5296-4ab9-8ba7-45293683467c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.085047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2e225891e445f8bb0c11f37bb47b17', 'request_id': 'req-63f16ff5-5296-4ab9-8ba7-45293683467c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.090803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2e225891e445f8bb0c11f37bb47b17', 'request_id': 'req-63f16ff5-5296-4ab9-8ba7-45293683467c'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.099095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:52.103984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] The token cache is being invalidate because project 4c2e225891e445f8bb0c11f37bb47b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:52.104276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.105175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-63f16ff5-5296-4ab9-8ba7-45293683467c tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.107044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 888/1795] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:52 2022] DELETE /identity/v3/projects/4c2e225891e445f8bb0c11f37bb47b17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:52.300042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:52.301831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:52.372103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70a6f-5042-4935-86ec-c03e74802555 tempest-VolumeQuotaClassesTest-81406738 tempest-VolumeQuotaClassesTest-81406738-project-admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:52.442170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:52.450264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:52.450997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:52.451365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:52.452017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] PATH_INFO: `/v3/users/0e1bbb8c1c884908996623a74c11a139` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:52.454416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1bbb8c1c884908996623a74c11a139)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:52.456690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:52.520557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1bbb8c1c884908996623a74c11a139'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.521236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1bbb8c1c884908996623a74c11a139'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.531045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1bbb8c1c884908996623a74c11a139'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.553201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1bbb8c1c884908996623a74c11a139'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.561358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1bbb8c1c884908996623a74c11a139'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:52.569015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 908/1796] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:52 2022] DELETE /identity/v3/users/0e1bbb8c1c884908996623a74c11a139 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:52.573461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:52.573983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:52.574123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:52.593723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:52.595000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:52.678317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 889/1797] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:52.688309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:52.689877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:52.751299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db169-c91b-40b6-af90-8dd381010973 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:52.755449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:52.755848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:52.756124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:52.756437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:52.768130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:52.769562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:52.782050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 909/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:53.104418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:53.105850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:53.118401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc32f0f-2da0-4326-9036-d6bef6c442b4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:53.122939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:53.123599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:53.123873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:53.124658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] PATH_INFO: `/v3/projects/725b14fc948f48f89c7fe66174f75e1e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:53.125758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=725b14fc948f48f89c7fe66174f75e1e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:53.127688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:53.187194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725b14fc948f48f89c7fe66174f75e1e', 'request_id': 'req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.195462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725b14fc948f48f89c7fe66174f75e1e', 'request_id': 'req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.201635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725b14fc948f48f89c7fe66174f75e1e', 'request_id': 'req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.213017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] The token cache is being invalidate because project 725b14fc948f48f89c7fe66174f75e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:53.213305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.213946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.215463 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 890/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:53 2022] DELETE /identity/v3/projects/725b14fc948f48f89c7fe66174f75e1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:53.219980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:53.229775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b387-60cf-4848-8594-815a5f98f4df service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:53.289612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:53.290157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:53.290436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:53.290705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] PATH_INFO: `/v3/users/62141be72ccd4588b22b89507c08be66` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:53.291855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62141be72ccd4588b22b89507c08be66)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:53.293745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:53.315712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:53.344670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62141be72ccd4588b22b89507c08be66'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.345330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62141be72ccd4588b22b89507c08be66'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.352607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62141be72ccd4588b22b89507c08be66'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.366070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62141be72ccd4588b22b89507c08be66'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.372745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-14b5411e-e147-4c83-b7a7-0284ae68a421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62141be72ccd4588b22b89507c08be66'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.378567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 910/1800] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:53 2022] DELETE /identity/v3/users/62141be72ccd4588b22b89507c08be66 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:53.728395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:53.729906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:53.755067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8673ea-55d2-4d77-9377-9cdc715ef3e9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:53.830797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:53.831661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:53.832042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:53.832416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] PATH_INFO: `/v3/projects/e6547de1f523446ea79420c8e397c255` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:53.834169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6547de1f523446ea79420c8e397c255)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:53.838426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:53.875636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:53.932243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6547de1f523446ea79420c8e397c255', 'request_id': 'req-92f746a3-298c-4200-b092-257fde2bcb8b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.944087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6547de1f523446ea79420c8e397c255', 'request_id': 'req-92f746a3-298c-4200-b092-257fde2bcb8b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.953129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6547de1f523446ea79420c8e397c255', 'request_id': 'req-92f746a3-298c-4200-b092-257fde2bcb8b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.967591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] The token cache is being invalidate because project e6547de1f523446ea79420c8e397c255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:53.967971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.968669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-92f746a3-298c-4200-b092-257fde2bcb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:53.970122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 891/1801] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:53 2022] DELETE /identity/v3/projects/e6547de1f523446ea79420c8e397c255 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:53.975589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:53.976082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:53.976455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.001930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:54.003415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:54.087837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 911/1802] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:54.090345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.090896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.091311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.173943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:54.181396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:54.201229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 892/1803] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:54.206077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.217422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a005-f7d0-48fc-a413-1c939cc8625e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.226588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.227294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.227553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.227827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.228478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:54.228779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.230393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.259366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 912/1804] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:09:54.261034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.271054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ded5e-4ad6-48dd-aa74-a1583e9f4256 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.276146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.276873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.277770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.277770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.278262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.280409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.313559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 893/1805] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:54.317838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.333984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b724450-5288-42ec-bf99-6048e25b3667 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.411387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.412046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.412890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.412890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.413258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.415395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.454913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 913/1806] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:54.459574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.474949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00742e4-4aef-4f97-ae3c-04a7bc0d2206 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.482599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.484678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.485061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.485436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.486237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.487991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.499258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 894/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:54.503039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.514573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c111-6f0a-4ba5-9a0d-5926f3abf74d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.528415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.531244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.531684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.531944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.532680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.534557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a19d13-9d8b-44ed-a04d-347a190f0f02 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.549236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 914/1808] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:54.553368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.565003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074efa-aed4-4447-a4fa-f57d354aed02 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.576639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.578199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.578870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.579225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] PATH_INFO: `/v3/projects/05fe29091bf543bbbcb8dabc37d476d9/users/75f4ab04efc542238298233a41f3ad64/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.602746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fe29091bf543bbbcb8dabc37d476d9, user_id=75f4ab04efc542238298233a41f3ad64, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.607306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.621274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 895/1809] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:54 2022] PUT /identity/v3/projects/05fe29091bf543bbbcb8dabc37d476d9/users/75f4ab04efc542238298233a41f3ad64/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:54.632386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.632821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.633151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.641133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:54.666233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] MFA Rules not processed for user `75f4ab04efc542238298233a41f3ad64`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:54.667560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:54.752344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 915/1810] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:54.757362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.825837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5393fa-0c05-4bc0-83e5-ef3e04fb46ea admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.831886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.832656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.833036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.833429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.834176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.836240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:54.868884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 896/1811] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:54.870259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:54.884423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be354-d57d-430e-aa07-f43c28f9d1b2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:54.951674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:54.952910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:54.953190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:54.953641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:54.954439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:54.956774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.020898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 916/1812] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:54 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:09:55.027378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.040635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a8576-1414-404e-8200-bf4a6c060459 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.045661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.046479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.046771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.047046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.047984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.052435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.065914 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 897/1813] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:09:55.070189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.082512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed272-f950-4d14-87a4-31dd3cdfe0e7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.089061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.090638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.091116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.091389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] PATH_INFO: `/v3/projects/73380786f7944685b404990ee4c75ff5/users/7633301bdfe244b2817a7a52b38d4112/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.113558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73380786f7944685b404990ee4c75ff5, user_id=7633301bdfe244b2817a7a52b38d4112, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.116591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.130929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 917/1814] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:55 2022] PUT /identity/v3/projects/73380786f7944685b404990ee4c75ff5/users/7633301bdfe244b2817a7a52b38d4112/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:55.134888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.145498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8521-7036-4b44-973b-a94771d5e25e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.168163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:55.213642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.214281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.214565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.215035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.215750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.217336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cdba1-475b-482d-a965-3149dc821a15 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.228088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 898/1815] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:09:55.232227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.243319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7027df-38c0-4911-8250-bd2782e64478 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.248401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.249060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.249372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.249641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] PATH_INFO: `/v3/projects/73380786f7944685b404990ee4c75ff5/users/7633301bdfe244b2817a7a52b38d4112/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.251587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73380786f7944685b404990ee4c75ff5, user_id=7633301bdfe244b2817a7a52b38d4112, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.254223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.265262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 918/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:09:55 2022] PUT /identity/v3/projects/73380786f7944685b404990ee4c75ff5/users/7633301bdfe244b2817a7a52b38d4112/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:55.275624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.275910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.276182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.304932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] MFA Rules not processed for user `7633301bdfe244b2817a7a52b38d4112`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:55.306132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:55.376736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 899/1817] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:55.387776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.389537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:55.445936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:55.458416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c9a7-04e8-47c7-aad8-392097b9994e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.462181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.462732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.463007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.463320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.472767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.474191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.483959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 919/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:55.596956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:55.606413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda8a9-07f2-483c-a17e-92214b396a2a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:55.610215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:55.610908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:55.611214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:55.611489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:55.672088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:55.673781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eecf8-77bc-4c6e-bf61-e0a3b5bc589c service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:55.682821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 900/1819] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:58.272063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:58.335794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afaa62-0d7d-4c85-98a3-1b658cd10860 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:58.340277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:58.340903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:58.341179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:58.341450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] PATH_INFO: `/v3/users/75f4ab04efc542238298233a41f3ad64` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:58.342549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f4ab04efc542238298233a41f3ad64)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:58.345033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:58.390279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f4ab04efc542238298233a41f3ad64'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.390952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f4ab04efc542238298233a41f3ad64'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.398152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f4ab04efc542238298233a41f3ad64'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.416487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f4ab04efc542238298233a41f3ad64'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.425274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f4ab04efc542238298233a41f3ad64'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.431495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 920/1820] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:58 2022] DELETE /identity/v3/users/75f4ab04efc542238298233a41f3ad64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:58.436372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:58.436857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:58.437032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:58.461202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:58.462432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:58.509718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:58.511065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:58.512543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:58.545312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:58.556906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:58.560338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:58.598589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ff0e-7174-4987-9a49-1055a6508825 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:58.603644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:58.604314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:58.604595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:58.604886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] PATH_INFO: `/v3/users/429ec3ab51df4072a06baaea8d9dd20c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:58.606113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429ec3ab51df4072a06baaea8d9dd20c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:58.608076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:58.615422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:58.625622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53b6f-f204-44ea-898e-4a8965850114 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:58.629629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:58.630354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:58.630735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:58.637230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:58.647927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:58.649458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0700724-29df-4e11-8026-ad662d332754 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:58.661620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 902/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:09:58.679023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429ec3ab51df4072a06baaea8d9dd20c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.679791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429ec3ab51df4072a06baaea8d9dd20c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.694031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429ec3ab51df4072a06baaea8d9dd20c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.714456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429ec3ab51df4072a06baaea8d9dd20c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.722774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429ec3ab51df4072a06baaea8d9dd20c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:58.741580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 921/1823] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:58 2022] DELETE /identity/v3/users/429ec3ab51df4072a06baaea8d9dd20c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:58.746403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1270031-4811-44df-b98f-956ebb89186b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:58.746806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1270031-4811-44df-b98f-956ebb89186b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:58.747218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1270031-4811-44df-b98f-956ebb89186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:58.779490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-d1270031-4811-44df-b98f-956ebb89186b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:58.779490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d1270031-4811-44df-b98f-956ebb89186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:58.908853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 903/1824] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:58.932405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:58.933939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.008396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022318e-ccb7-48ff-9434-badaa0c94218 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.012186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.013175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.013175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.013335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.025173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.027491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.042049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 922/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:59.168049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1270031-4811-44df-b98f-956ebb89186b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.169666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d1270031-4811-44df-b98f-956ebb89186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.182937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1270031-4811-44df-b98f-956ebb89186b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.188854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.189685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.190425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.190425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] PATH_INFO: `/v3/projects/05fe29091bf543bbbcb8dabc37d476d9` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.191694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fe29091bf543bbbcb8dabc37d476d9)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.194113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.259062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.282512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d811-35a1-46e8-a549-6ec2b5b15733 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.287708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fe29091bf543bbbcb8dabc37d476d9', 'request_id': 'req-4773ac99-f9b6-44c5-9700-5477a32b2c2d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.299562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fe29091bf543bbbcb8dabc37d476d9', 'request_id': 'req-4773ac99-f9b6-44c5-9700-5477a32b2c2d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.310240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fe29091bf543bbbcb8dabc37d476d9', 'request_id': 'req-4773ac99-f9b6-44c5-9700-5477a32b2c2d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.331595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] The token cache is being invalidate because project 05fe29091bf543bbbcb8dabc37d476d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:59.332508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.333368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.338453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 904/1826] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:59 2022] DELETE /identity/v3/projects/05fe29091bf543bbbcb8dabc37d476d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:59.339861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.343759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.358014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:59.367960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.368912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.369436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.369970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.372158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.436670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac99-f9b6-44c5-9700-5477a32b2c2d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.439577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:59.442046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.442810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.443282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.443494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] PATH_INFO: `/v3/users/7633301bdfe244b2817a7a52b38d4112` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.445035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7633301bdfe244b2817a7a52b38d4112)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.447335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.482153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.484799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.513678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 923/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:09:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:09:59.513678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.513678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.529192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782abaa-d98e-419f-9f88-5b1c8dbb5c89 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.532362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7633301bdfe244b2817a7a52b38d4112'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.535311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.536520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.536960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.537234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] PATH_INFO: `/v3/projects/6080cd7ecd6f4121bed52bd8a10ed153` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.538429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6080cd7ecd6f4121bed52bd8a10ed153)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.540360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.547051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7633301bdfe244b2817a7a52b38d4112'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.557245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7633301bdfe244b2817a7a52b38d4112'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.572815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7633301bdfe244b2817a7a52b38d4112'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.573571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f0858e66-7be7-41b7-b75c-b697a6a938f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7633301bdfe244b2817a7a52b38d4112'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.583115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 905/1828] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:09:59 2022] DELETE /identity/v3/users/7633301bdfe244b2817a7a52b38d4112 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:59.613865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6080cd7ecd6f4121bed52bd8a10ed153', 'request_id': 'req-29159169-5923-436a-a153-30caa9ce7320'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.620113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6080cd7ecd6f4121bed52bd8a10ed153', 'request_id': 'req-29159169-5923-436a-a153-30caa9ce7320'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.628114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6080cd7ecd6f4121bed52bd8a10ed153', 'request_id': 'req-29159169-5923-436a-a153-30caa9ce7320'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.646015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] The token cache is being invalidate because project 6080cd7ecd6f4121bed52bd8a10ed153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:09:59.646372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.647007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-29159169-5923-436a-a153-30caa9ce7320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:09:59.648729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 924/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:59 2022] DELETE /identity/v3/projects/6080cd7ecd6f4121bed52bd8a10ed153 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:09:59.654043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.654355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.654627 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.677072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:59.678393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.767299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 906/1830] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:59.776778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.777114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.777394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.802864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:09:59.804337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.813252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 925/1831] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:09:59.817909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.830985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccd79a-31cf-46c7-83c3-efce4d18d9f6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.837000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.837633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.838002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.838345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.839104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:09:59.839480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.841135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.855035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 907/1832] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:09:59.860167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.891531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5979-85f7-4c84-b94b-6aa186dcfef3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.907089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:09:59.909645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.910664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:09:59.917910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.918817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.919479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.921220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.925263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.952715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced2db-963b-489e-85ea-4241ffae060b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:09:59.957818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:09:59.958562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:09:59.958960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:09:59.959332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] PATH_INFO: `/v3/projects/73380786f7944685b404990ee4c75ff5` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:09:59.960536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73380786f7944685b404990ee4c75ff5)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:09:59.962988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:09:59.975520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:09:59.992008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 926/1833] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:09:59 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:09:59.994709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.026888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73380786f7944685b404990ee4c75ff5', 'request_id': 'req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:00.041936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73380786f7944685b404990ee4c75ff5', 'request_id': 'req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:00.053438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73380786f7944685b404990ee4c75ff5', 'request_id': 'req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:00.072515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] The token cache is being invalidate because project 73380786f7944685b404990ee4c75ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:00.072807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:00.073487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d4a07bb9-8441-4aeb-a5c7-9f23c9565cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:00.075619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 908/1834] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:09:59 2022] DELETE /identity/v3/projects/73380786f7944685b404990ee4c75ff5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:00.081117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84da9d-e86c-4fe5-b935-ea367e04b7ed None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.081117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84da9d-e86c-4fe5-b935-ea367e04b7ed None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.081117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84da9d-e86c-4fe5-b935-ea367e04b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.094844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a8a67-ce13-4c60-9ff9-240ea1ca758b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.119902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5d84da9d-e86c-4fe5-b935-ea367e04b7ed None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:00.122151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5d84da9d-e86c-4fe5-b935-ea367e04b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:00.152366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:00.192275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.193523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.194102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.194530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.196916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.199240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.251986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 927/1835] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:09:59 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:00.257425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.261697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:00.285221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48897744-de6f-48f0-bc92-a0d7a36ea319 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.292702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 909/1836] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:00.303471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.303767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.304166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.323723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.325204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.325563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.327013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.328397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.331910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:00.334156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:00.335644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.357020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 910/1837] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:00.358051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.372645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c0e5-620a-449d-bb15-2b38574c49eb None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.373657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 928/1838] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:00.377622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.396389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922603-dc09-40fe-b5c0-fada086953fc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.401120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.403633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.404046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.404451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.404923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.405475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.415020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:10:00.415368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.416988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.421332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.423653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.424549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.428969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.458155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 911/1839] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:10:00.459058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.459926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 929/1840] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:00.466596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.482808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50a9ee-f208-4586-9ed1-20f6e5ba15be admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.484829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c512e-5798-49ff-a410-c8447e64197d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.492119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.492566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.492868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.493218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.493320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.493487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.493581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.493816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] PATH_INFO: `/v3/projects/06084ad6c334482d8855cdcdb91bb223/users/9c904da31a854e7ea2ecc251ca9af74a/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.494784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.496838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.544656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06084ad6c334482d8855cdcdb91bb223, user_id=9c904da31a854e7ea2ecc251ca9af74a, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.545280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 912/1841] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:00.551453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a972a-8aba-426b-b796-622ef28798f4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.551792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.582270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 930/1842] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:00 2022] PUT /identity/v3/projects/06084ad6c334482d8855cdcdb91bb223/users/9c904da31a854e7ea2ecc251ca9af74a/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:00.592771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.593150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.593846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.625880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] MFA Rules not processed for user `9c904da31a854e7ea2ecc251ca9af74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:00.627154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:00.653192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:00.660523 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2aa0b-826b-4aec-ae9d-47f2f9c8d140 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.709396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 931/1843] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:00.725807 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.728549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:00.751699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.752512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.752653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.753149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.753794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.756039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.781879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 913/1844] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/users => generated 305 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:00.785894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.802245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa49f-ac42-4e0d-b73f-9365e2ce9a45 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.804592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5748d-d85a-4401-9391-10ac0d2e42f1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.809514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.809743 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.810189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.810446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.810591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.810722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.810851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.815238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.815238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.815238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.826810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.827479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 914/1845] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:00.828408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.831390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.839345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 932/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:00.843473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dead9-96d9-4193-b99a-c392ff97f799 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.848485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.849090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.849367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.849636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.850294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.852157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b74c-c9aa-4367-a5d0-a3aed0bd6d54 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.866497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 915/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:00.870497 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:00.882574 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b643-b58f-4c75-b821-25f69b1c22f3 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:00.902273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:00.903039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.903670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.903952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] PATH_INFO: `/v3/projects/c035d8a7b19e4b6b94e341cc7b9f9092/users/04bc6dd7f0b84c3eba2855ca6a48f7a7/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.924449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:00.927607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c035d8a7b19e4b6b94e341cc7b9f9092, user_id=04bc6dd7f0b84c3eba2855ca6a48f7a7, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:00.930448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:00.946514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 933/1848] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:00 2022] PUT /identity/v3/projects/c035d8a7b19e4b6b94e341cc7b9f9092/users/04bc6dd7f0b84c3eba2855ca6a48f7a7/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:00.958402 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:00.958689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:00.959019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:00.993216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] MFA Rules not processed for user `04bc6dd7f0b84c3eba2855ca6a48f7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:00.994919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:01.082710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 916/1849] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:01.087113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.197648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc543-a2fe-477e-ba81-6482a5abb1e1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.205296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.206062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.206658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.207348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.207981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.209870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.259684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 934/1850] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:01 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:01.265288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.282705 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f255b0e-60d0-4129-9e2d-33f67703b5b9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.360975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.361602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.361882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.362156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.362794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.364777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.374392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:01.390730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 917/1851] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:01 2022] POST /identity/v3/users => generated 311 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:01.392585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.403101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad43ab9-72da-45fa-87f2-9dc753bdd814 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.407905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.408579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.408930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.409276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.410012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.411622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.422338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 935/1852] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:01.426855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.437803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b06eb9-cb5a-4004-afe6-fda1a159b7b1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.443724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.444478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.444833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.445204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] PATH_INFO: `/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4/users/81cb418ccf834de293a40b7e56142025/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.463692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15baa9b7ea4f442fa385633ad5e8cef4, user_id=81cb418ccf834de293a40b7e56142025, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.466782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.496308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 918/1853] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:01 2022] PUT /identity/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4/users/81cb418ccf834de293a40b7e56142025/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:10:01.496487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.512044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc715b-3007-46ae-ba3c-76a2cf740411 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.620379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.621348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.621638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.621917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.623094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.624911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fcd30-ecb6-4007-8182-e2b2a47d0931 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.644456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 936/1854] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:01.648334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:01.711179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a8fd-67c0-4f2f-a748-a578520706fd admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:01.725506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:01.726205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.726480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.726758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] PATH_INFO: `/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4/users/81cb418ccf834de293a40b7e56142025/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.741489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15baa9b7ea4f442fa385633ad5e8cef4, user_id=81cb418ccf834de293a40b7e56142025, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:01.751299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:01.789215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 919/1855] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:01 2022] PUT /identity/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4/users/81cb418ccf834de293a40b7e56142025/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:01.799826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:01.800138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:01.801509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:01.836308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] MFA Rules not processed for user `81cb418ccf834de293a40b7e56142025`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:01.837604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:01.901750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:01.986496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 937/1856] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:01.998515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:02.004812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:02.128471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495a30-8921-4d22-9a1a-f04277c146f7 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:02.139604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:02.143865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:02.144088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:02.146321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:02.172291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:02.174103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:02.192502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 920/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:02.473581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:02.485359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5775e1-45d1-4c1a-811b-e8c7c9658f53 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:02.490321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:02.491587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:02.491977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:02.492385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:02.598086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:02.600037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a7db7-a423-44f4-b355-bdbf1ef311ee service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:02.612458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 938/1858] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:02 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:08.339770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:08.407470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2e7-82f3-43e4-ba75-08d08a59d8f6 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:08.415158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:08.415858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:08.416105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:08.416379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] PATH_INFO: `/v3/users/04bc6dd7f0b84c3eba2855ca6a48f7a7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:08.417968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bc6dd7f0b84c3eba2855ca6a48f7a7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:08.420342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:08.470123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bc6dd7f0b84c3eba2855ca6a48f7a7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:08.477857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bc6dd7f0b84c3eba2855ca6a48f7a7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:08.480531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:08.488678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bc6dd7f0b84c3eba2855ca6a48f7a7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:08.503750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bc6dd7f0b84c3eba2855ca6a48f7a7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:08.504514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bc6dd7f0b84c3eba2855ca6a48f7a7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:08.512994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 921/1859] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:08 2022] DELETE /identity/v3/users/04bc6dd7f0b84c3eba2855ca6a48f7a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:08.518206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:08.518703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:08.518854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:08.543927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:08.545367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:08.610423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 939/1860] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:08.619946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:08.621479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:08.680935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fde-3c6e-4105-8228-5ab89e6573ed admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:08.685112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:08.685723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:08.686004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:08.686379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:08.705325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:08.707911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:08.719995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 922/1861] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:08.999244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:09.001425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:09.018474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350c05-f45e-4f31-811c-8350ebdecdd5 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:09.023545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:09.024189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.024467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.024829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] PATH_INFO: `/v3/projects/c035d8a7b19e4b6b94e341cc7b9f9092` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.025867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c035d8a7b19e4b6b94e341cc7b9f9092)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:09.027795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:09.080489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c035d8a7b19e4b6b94e341cc7b9f9092', 'request_id': 'req-95ec1de2-da92-4a4b-a233-73ac78e2564a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.086259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c035d8a7b19e4b6b94e341cc7b9f9092', 'request_id': 'req-95ec1de2-da92-4a4b-a233-73ac78e2564a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.092677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c035d8a7b19e4b6b94e341cc7b9f9092', 'request_id': 'req-95ec1de2-da92-4a4b-a233-73ac78e2564a'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.106250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] The token cache is being invalidate because project c035d8a7b19e4b6b94e341cc7b9f9092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:09.106541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.107209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.108823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 940/1862] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:08 2022] DELETE /identity/v3/projects/c035d8a7b19e4b6b94e341cc7b9f9092 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:09.112899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:09.122819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067cf83-1acc-47c8-9b3a-f25e525fde07 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:09.207977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:09.208751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.209033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.209330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] PATH_INFO: `/v3/users/81cb418ccf834de293a40b7e56142025` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.210467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cb418ccf834de293a40b7e56142025)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:09.212599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:09.288029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cb418ccf834de293a40b7e56142025'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.296709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cb418ccf834de293a40b7e56142025'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.306594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cb418ccf834de293a40b7e56142025'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.321145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cb418ccf834de293a40b7e56142025'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.321866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a7e8ba3b-bb0f-4ce6-9789-dd29371a9196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cb418ccf834de293a40b7e56142025'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.323540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:09.339171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 923/1863] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:09 2022] DELETE /identity/v3/users/81cb418ccf834de293a40b7e56142025 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:09.630181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:09.631744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:09.653190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec1de2-da92-4a4b-a233-73ac78e2564a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:09.659094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:09.716382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:09.717956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.718287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.718564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] PATH_INFO: `/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.719744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15baa9b7ea4f442fa385633ad5e8cef4)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:09.721659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:09.769055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15baa9b7ea4f442fa385633ad5e8cef4', 'request_id': 'req-f294909b-697d-4d1e-b947-81dd8050a247'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.775294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15baa9b7ea4f442fa385633ad5e8cef4', 'request_id': 'req-f294909b-697d-4d1e-b947-81dd8050a247'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.782670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15baa9b7ea4f442fa385633ad5e8cef4', 'request_id': 'req-f294909b-697d-4d1e-b947-81dd8050a247'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.798156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] The token cache is being invalidate because project 15baa9b7ea4f442fa385633ad5e8cef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:09.798584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.799292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f294909b-697d-4d1e-b947-81dd8050a247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:09.800979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 941/1864] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:09 2022] DELETE /identity/v3/projects/15baa9b7ea4f442fa385633ad5e8cef4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:09.806164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.806629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.806763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.829384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:09.829384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:09.894814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 924/1865] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:09.902347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.902633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.902906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.925730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:09.927035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:09.935859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 942/1866] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:10:09.940500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:09.954341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90859e-e16e-4ec3-9d12-a4e45c4e970e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:09.961919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:09.963052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:09.963757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:09.964277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:09.966292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:10:09.967303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:09.970763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:09.988100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 925/1867] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:10:09.989336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:09.999487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423a0e-70dd-45e5-9e09-705a7342a592 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.004263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.004868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.005142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.005662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.006291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.008650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.042537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 943/1868] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:09 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:10.046947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.058181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d70c-db8d-48a3-945d-274ab92bf732 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.127876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.129046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.129339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.129760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.130425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.132469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.164616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 926/1869] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:10 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:10.168710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.180556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f939-0972-4b3e-8460-5bc1b954e6ee admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.185280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.185883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.186224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.186500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.187163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.188741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.203221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 944/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:10.204466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.215200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ced756-352a-45a8-8e26-7b6916dffb8f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.220374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.221243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.221440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.221661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.222427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.224155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f981cfc-584e-4325-bfc0-07ef96f2388b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.237263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 927/1871] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:10.241706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.254767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92dd72-8c09-442b-b354-9cf1bad262e5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.260704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.261378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.262245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.262245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] PATH_INFO: `/v3/projects/697314dd73a44cd3a959573750ca0292/users/e9f490e5aed4494496ce830332e80aa5/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.281627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=697314dd73a44cd3a959573750ca0292, user_id=e9f490e5aed4494496ce830332e80aa5, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.285506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.306278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 945/1872] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:10 2022] PUT /identity/v3/projects/697314dd73a44cd3a959573750ca0292/users/e9f490e5aed4494496ce830332e80aa5/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:10.324471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.324812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.325087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.388421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] MFA Rules not processed for user `e9f490e5aed4494496ce830332e80aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:10.390354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:10.536022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:10.549941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 928/1873] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:10.554427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.605045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:10.654451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be111-b6fc-4493-83f8-772ce07e4e2b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.663161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.664029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.664488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.664914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.665947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.668605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.713714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 946/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:10.718012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.729763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d40ff-78a5-4c9f-83e5-bc2d88fcd9b9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.810644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.812450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.812450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.812450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.813046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.814954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.839911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 929/1875] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:10 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:10.844729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.860082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcce22-64ce-4046-b1c2-1d4107a690f5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.874425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.875261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.875611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.876003 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.876733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.878741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.894707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 947/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:10.900576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.912734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcca7c-69a2-42ac-8b75-5293d8023acb admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.920056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.921631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.922149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.923528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.924364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.926055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d493a-3a7f-4b74-8fd2-859737396022 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.939381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 930/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:10.943740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:10.954874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83f-da75-41c1-ac39-177ddc6277e5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:10.960006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:10.960678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:10.960964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:10.961242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] PATH_INFO: `/v3/projects/1763e516b100492dbea34b9edfcf0482/users/5f6ca6bfc9854c2497ed52be36b792c1/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:10.977913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1763e516b100492dbea34b9edfcf0482, user_id=5f6ca6bfc9854c2497ed52be36b792c1, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:10.980709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:10.996708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 948/1878] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:10 2022] PUT /identity/v3/projects/1763e516b100492dbea34b9edfcf0482/users/5f6ca6bfc9854c2497ed52be36b792c1/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:11.008136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.008432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.008696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.042053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] MFA Rules not processed for user `5f6ca6bfc9854c2497ed52be36b792c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:11.043484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.124006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 931/1879] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:11.128639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.210674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cfe4e-1bfe-408c-8b81-f3c4b818d457 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.216165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.217973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.218320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.218597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.219392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.221565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.256677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 949/1880] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:11.257826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.269601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47dac-a99f-473d-97b7-2a5522968b3d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.331149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.331841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.332121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.332410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.333123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.335298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.346213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:11.367042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 932/1881] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:11 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:11.368278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.379612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3933349-8076-4ffa-a64e-792fdcb0e73a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.395651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.396316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.396600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.396908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.397559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.399283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.411683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 950/1882] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:11.415915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.431278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43540b9-6252-42f9-9cf8-c55bb9373d44 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.436949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.437968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.437968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.438179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] PATH_INFO: `/v3/projects/fab5842b8b17408b9d9af714c612dcf4/users/182cded6d34848738c11fab771a61661/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.456109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab5842b8b17408b9d9af714c612dcf4, user_id=182cded6d34848738c11fab771a61661, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.459859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.474845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 933/1883] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:11 2022] PUT /identity/v3/projects/fab5842b8b17408b9d9af714c612dcf4/users/182cded6d34848738c11fab771a61661/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:11.478508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.490029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a1f51-e98d-4203-8de6-0faa47fbf1fd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.557548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.560002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.588917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.589681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.590098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.590389 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.591033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.593200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.594862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:11.607275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 951/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:11.612055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.622162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc305-9b44-45b2-9dfc-28c05dc8c918 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.627352 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.628011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.628291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.628571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] PATH_INFO: `/v3/projects/fab5842b8b17408b9d9af714c612dcf4/users/182cded6d34848738c11fab771a61661/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.631569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab5842b8b17408b9d9af714c612dcf4, user_id=182cded6d34848738c11fab771a61661, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.634638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa89f-28c8-49cb-8d0b-5cc6e199224f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.641494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87c5e-8ab5-4a84-94d3-e30873f416ed admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.646700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.647496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.647644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.647923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] PATH_INFO: `/v3/users/9c904da31a854e7ea2ecc251ca9af74a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.649219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c904da31a854e7ea2ecc251ca9af74a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:11.659109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 952/1885] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:11 2022] PUT /identity/v3/projects/fab5842b8b17408b9d9af714c612dcf4/users/182cded6d34848738c11fab771a61661/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:10:11.659808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:11.663310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.663540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.663822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.697407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] MFA Rules not processed for user `182cded6d34848738c11fab771a61661`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:11.698634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.712577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c904da31a854e7ea2ecc251ca9af74a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:11.725385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c904da31a854e7ea2ecc251ca9af74a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:11.740131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c904da31a854e7ea2ecc251ca9af74a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:11.761636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c904da31a854e7ea2ecc251ca9af74a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:11.761636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dcec5441-d62f-49d9-b477-8db76f770706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c904da31a854e7ea2ecc251ca9af74a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:11.767586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 934/1886] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:11 2022] DELETE /identity/v3/users/9c904da31a854e7ea2ecc251ca9af74a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:11.771979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.772390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.772741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.793206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:11.794502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.794736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 953/1887] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:10:11.806654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.809262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.858036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:11.888799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 935/1888] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:10:11.889171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8f5c-d0e6-436c-a795-4d9903bf29af None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.899645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:11.901751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:11.949868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.950931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.950931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.951626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.982579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903458e3-4114-4cc0-bc00-9635cebff905 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:11.987807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:11.988541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:11.988816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:11.989851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:11.994500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:12.005149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:12.006978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:12.019100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 936/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:10:12.031188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:12.032252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3995ba-3ccb-4617-b290-6b1ad01c2439 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:12.042361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 954/1890] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:12.090813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:12.090813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:12.104516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f228ad-6fe3-47bd-be78-cb10e6375b73 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:12.108530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:12.109143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:12.109584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:12.109893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:12.111856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:12.193962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:12.196074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:12.208195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 937/1891] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:12.301357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:12.301631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:12.301895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:12.344964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] MFA Rules not processed for user `a925c18e67894c06863e68b2793488d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:12.346549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:12.432066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:12.433704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:12.441445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 955/1892] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:12.468132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e107a31-3255-4dac-baf5-bf188c51bef7 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:12.482329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:12.483651 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:12.483912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:12.484182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] PATH_INFO: `/v3/projects/06084ad6c334482d8855cdcdb91bb223` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:12.486134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06084ad6c334482d8855cdcdb91bb223)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:12.488727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:12.592948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06084ad6c334482d8855cdcdb91bb223', 'request_id': 'req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:12.614871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06084ad6c334482d8855cdcdb91bb223', 'request_id': 'req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:12.641526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06084ad6c334482d8855cdcdb91bb223', 'request_id': 'req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:12.692526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] The token cache is being invalidate because project 06084ad6c334482d8855cdcdb91bb223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:12.699552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:12.700331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-392316ca-d975-47e9-aa6e-b1ce5fa6c94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:12.704509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 938/1893] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:12 2022] DELETE /identity/v3/projects/06084ad6c334482d8855cdcdb91bb223 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:15.456942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:15.458468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:15.472240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fc726-5101-4d3a-b7dc-02ecfacec701 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:15.537513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:15.538162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:15.538438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:15.538910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] PATH_INFO: `/v3/users/e9f490e5aed4494496ce830332e80aa5` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:15.540211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f490e5aed4494496ce830332e80aa5)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:15.542288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:15.596613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f490e5aed4494496ce830332e80aa5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:15.597472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f490e5aed4494496ce830332e80aa5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:15.607528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f490e5aed4494496ce830332e80aa5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:15.630220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f490e5aed4494496ce830332e80aa5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:15.645241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f490e5aed4494496ce830332e80aa5'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:15.647132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:15.652823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 956/1894] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:15 2022] DELETE /identity/v3/users/e9f490e5aed4494496ce830332e80aa5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:15.658109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:15.658652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:15.658652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:15.680455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:15.681724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:15.687386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:15.761235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 939/1895] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:15.772300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:15.773743 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:15.875447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc636e-5918-4ca6-b89c-ed7feab869ac admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:15.880066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:15.880844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:15.881126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:15.881399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:15.893227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:15.893912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:15.920343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 957/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:16.581151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:16.583668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:16.604018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ae01-8746-4495-8640-6759ed2f6f18 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:16.612277 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:16.613093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:16.613477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:16.613853 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] PATH_INFO: `/v3/projects/697314dd73a44cd3a959573750ca0292` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:16.615118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697314dd73a44cd3a959573750ca0292)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:16.617163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:16.671339 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697314dd73a44cd3a959573750ca0292', 'request_id': 'req-056987fc-e03b-4a48-b964-255585e808b0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.680879 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697314dd73a44cd3a959573750ca0292', 'request_id': 'req-056987fc-e03b-4a48-b964-255585e808b0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.690027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697314dd73a44cd3a959573750ca0292', 'request_id': 'req-056987fc-e03b-4a48-b964-255585e808b0'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.702998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] The token cache is being invalidate because project 697314dd73a44cd3a959573750ca0292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:16.703310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.703964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.705494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 940/1897] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:16 2022] DELETE /identity/v3/projects/697314dd73a44cd3a959573750ca0292 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:16.709666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:16.721274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41fdc-9e60-463a-ba6f-b1a11d39a629 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:16.788432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:16.789061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:16.789339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:16.790731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] PATH_INFO: `/v3/users/5f6ca6bfc9854c2497ed52be36b792c1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:16.791649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6ca6bfc9854c2497ed52be36b792c1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:16.795987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:16.876248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6ca6bfc9854c2497ed52be36b792c1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.876917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6ca6bfc9854c2497ed52be36b792c1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.885750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6ca6bfc9854c2497ed52be36b792c1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.912968 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6ca6bfc9854c2497ed52be36b792c1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.924972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-234401dc-afd7-4014-90a3-2909ac041712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6ca6bfc9854c2497ed52be36b792c1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:16.934748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 958/1898] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:16 2022] DELETE /identity/v3/users/5f6ca6bfc9854c2497ed52be36b792c1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:17.818967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:17.821011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:17.837694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056987fc-e03b-4a48-b964-255585e808b0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:17.938569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:17.939580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:17.940103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:17.940557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] PATH_INFO: `/v3/projects/1763e516b100492dbea34b9edfcf0482` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:17.941836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1763e516b100492dbea34b9edfcf0482)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:17.944420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:17.989871 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:18.003787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1763e516b100492dbea34b9edfcf0482', 'request_id': 'req-eee146e0-c234-4a79-b0ce-594df439e235'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.013919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1763e516b100492dbea34b9edfcf0482', 'request_id': 'req-eee146e0-c234-4a79-b0ce-594df439e235'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.022041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1763e516b100492dbea34b9edfcf0482', 'request_id': 'req-eee146e0-c234-4a79-b0ce-594df439e235'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.045585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] The token cache is being invalidate because project 1763e516b100492dbea34b9edfcf0482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:18.046105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.046965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.049270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 941/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:17 2022] DELETE /identity/v3/projects/1763e516b100492dbea34b9edfcf0482 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:18.053494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.054011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:18.054122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.054122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.055855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.076554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] MFA Rules not processed for user `a8eddc1a05c14b26acaf7997784f9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:18.077810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.093292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:18.130643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee146e0-c234-4a79-b0ce-594df439e235 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:18.135344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:18.136430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.136642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.137157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] PATH_INFO: `/v3/users/182cded6d34848738c11fab771a61661` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.138225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] RBAC: Authorizing `identity:delete_user(user_id=182cded6d34848738c11fab771a61661)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:18.140343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:18.143722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 959/1900] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:18.205616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182cded6d34848738c11fab771a61661'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.213519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182cded6d34848738c11fab771a61661'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.224464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:18.225729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182cded6d34848738c11fab771a61661'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.226204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.240814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182cded6d34848738c11fab771a61661'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.241843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1ce88ea3-448f-4735-8b7b-2b3294a0162c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182cded6d34848738c11fab771a61661'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.242496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acdf1d-3579-454e-9482-63c6ab4eeb4b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:18.252562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 942/1901] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:18 2022] DELETE /identity/v3/users/182cded6d34848738c11fab771a61661 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:18.262923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:18.266002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.266436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.266868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] PATH_INFO: `/v3/users/cf22bff688d24f3fb2720dd7110613d3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.269670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf22bff688d24f3fb2720dd7110613d3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:18.273541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:18.353167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf22bff688d24f3fb2720dd7110613d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.353919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf22bff688d24f3fb2720dd7110613d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.364842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf22bff688d24f3fb2720dd7110613d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.401697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf22bff688d24f3fb2720dd7110613d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.450118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf22bff688d24f3fb2720dd7110613d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:18.458874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 960/1902] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:10:18 2022] DELETE /identity/v3/users/cf22bff688d24f3fb2720dd7110613d3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:18.465502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.467641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.468135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.494530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:18.495946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.605164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:18.665038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 943/1903] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:18.683487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:18.687890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.867452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53950e03-1afa-44b9-9494-962eb2f09cb7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:18.884606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:18.885712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.886338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.886656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.905683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:18.907119 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:18.927349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:18.928672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab722f-c9ee-4d4b-a470-75168192f627 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:18.941994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2eb0-0223-4e8e-93ce-a427657e3ad6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:18.945396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 961/1904] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:18.963429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:18.966594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:18.968377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:18.970707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] PATH_INFO: `/v3/projects/fab5842b8b17408b9d9af714c612dcf4` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:18.976823 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab5842b8b17408b9d9af714c612dcf4)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:18.987575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.154817 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab5842b8b17408b9d9af714c612dcf4', 'request_id': 'req-2890f270-5287-4d5c-bf42-78e9fa6d9371'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.169419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab5842b8b17408b9d9af714c612dcf4', 'request_id': 'req-2890f270-5287-4d5c-bf42-78e9fa6d9371'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.180489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab5842b8b17408b9d9af714c612dcf4', 'request_id': 'req-2890f270-5287-4d5c-bf42-78e9fa6d9371'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.200171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] The token cache is being invalidate because project fab5842b8b17408b9d9af714c612dcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:19.200446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.201974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2890f270-5287-4d5c-bf42-78e9fa6d9371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.204516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 944/1905] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:18 2022] DELETE /identity/v3/projects/fab5842b8b17408b9d9af714c612dcf4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:19.212443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.213269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.213735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.235519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:19.236858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:19.325372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:19.363598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 962/1906] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:19.371779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.372043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.372318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.397600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:19.399427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:19.416223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 945/1907] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:19.421315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.433027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5ff0-6f49-480e-9690-4ce1dcc31d20 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.447056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.448002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.449442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.449621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.451679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:10:19.452905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.457298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.486054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 963/1908] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:10:19.490386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.500500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021cad-ca1c-43ee-80e9-9182ba211ac4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.506004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.506410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.506687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.507125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.507726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.509970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.567571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 946/1909] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:19.571965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.572545 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.574601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:19.594395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d827-5496-41ed-8980-2d3e903f45ea admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.686099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe09a-3b10-4230-b868-9a0b10551acb admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.692803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.694316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.694781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.695173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] PATH_INFO: `/v3/projects/0468837ceda543dc97c7dd749703dc98` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.697318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0468837ceda543dc97c7dd749703dc98)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.701010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.729120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.729751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.730186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.730494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.731237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.733740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.768547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 964/1910] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:19.770265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.783680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d038ae7-0664-49ab-86a1-fcdde69a29f4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.788382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:19.797987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0468837ceda543dc97c7dd749703dc98', 'request_id': 'req-80895692-6092-4609-9a6d-d3cae1bcb311'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.811243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0468837ceda543dc97c7dd749703dc98', 'request_id': 'req-80895692-6092-4609-9a6d-d3cae1bcb311'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.822023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0468837ceda543dc97c7dd749703dc98', 'request_id': 'req-80895692-6092-4609-9a6d-d3cae1bcb311'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.835976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] The token cache is being invalidate because project 0468837ceda543dc97c7dd749703dc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:10:19.837509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.839324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-80895692-6092-4609-9a6d-d3cae1bcb311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:10:19.842123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 947/1911] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:10:19 2022] DELETE /identity/v3/projects/0468837ceda543dc97c7dd749703dc98 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:19.848367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9e28-7e2f-4b7c-bf02-e4195c212732 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.848785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9e28-7e2f-4b7c-bf02-e4195c212732 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.849191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9e28-7e2f-4b7c-bf02-e4195c212732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.879305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4d6a9e28-7e2f-4b7c-bf02-e4195c212732 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:19.880667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4d6a9e28-7e2f-4b7c-bf02-e4195c212732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:19.915687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.916368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.916651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.916924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.917725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.919214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.931250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 965/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:19.934820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.936734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:19.950314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28d27e-10c5-4d9f-8bd2-b00d6db6372b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:19.956558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:19.957127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.957414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.957681 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.958439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:19.966522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:19.984721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 948/1913] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:19.985275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 966/1914] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:19.988497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:19.988628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:19.988707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:19.988707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:19.998991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd63ac-2a54-49a3-8c40-cb03e82921da admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.004589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.005374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.005912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.006293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] PATH_INFO: `/v3/projects/f01223d5c5e745b78271f584abe0d298/users/ff91d43c564b48c8a5c7869dba23d419/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.023871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01223d5c5e745b78271f584abe0d298, user_id=ff91d43c564b48c8a5c7869dba23d419, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.027834 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47a62d-a9e2-4ee4-8dee-1a412d899fcd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.030065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:20.031970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:20.045927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 949/1915] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:20.050809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.051153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 967/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:19 2022] PUT /identity/v3/projects/f01223d5c5e745b78271f584abe0d298/users/ff91d43c564b48c8a5c7869dba23d419/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:20.054391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.054828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.055628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.061368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9dd4-a23b-44b7-9172-8eaddd3ba1b2 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.097697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:20.099105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:20.113717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:20.154940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.155752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.156034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.156304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.156946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:10:20.157246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.158833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.173182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 950/1917] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:10:20.177401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 968/1918] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:20.177540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.189687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3bb9-768c-4e39-b4be-ebf22a26001c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.191115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.193351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:20.202739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.203607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.203952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.204441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.205147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.208619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.256965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 951/1919] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:20 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:20.257855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.286121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370bc26-d0c6-4af9-965f-36b748c03c3e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.316154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:20.344858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.345617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.345963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.346308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.354583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20860-772d-4fb8-b4ff-8495c725edb3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.359903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.360548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.360656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.360850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.361103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.361734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.362428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.363799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.373797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 969/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:20.391801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 952/1921] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:20 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:20.393261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.405128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4f01-b835-4528-bac8-10a34747c543 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.410085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.410692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.410975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.411300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.411934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.413526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.424714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 970/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:20.428445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.439338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8124b-305c-4f11-b1cd-bc6d3df01070 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.445370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.445942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.446229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.446498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.447176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.448785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39cf3-2eed-4086-b5d4-55993c02dff5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.460799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 953/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:20.465178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.475902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d857a8-8fd4-42ff-9b53-eead75ad79f4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.480727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.481420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.481825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.482106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] PATH_INFO: `/v3/projects/58a9386d32784072aa1aa00715ad3eae/users/e471a36a66f54520ae2b4b2548e1d315/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.497936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9386d32784072aa1aa00715ad3eae, user_id=e471a36a66f54520ae2b4b2548e1d315, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.501224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.514019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 971/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:20 2022] PUT /identity/v3/projects/58a9386d32784072aa1aa00715ad3eae/users/e471a36a66f54520ae2b4b2548e1d315/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:20.520454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be85d-5275-4064-bc0e-b4cc64ceaf76 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.521013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be85d-5275-4064-bc0e-b4cc64ceaf76 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.521450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be85d-5275-4064-bc0e-b4cc64ceaf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.549346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ec3be85d-5275-4064-bc0e-b4cc64ceaf76 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:20.551131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ec3be85d-5275-4064-bc0e-b4cc64ceaf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:20.613754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 954/1925] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:20.623540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:20.625343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:20.679530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:20.695523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c24c-8403-47cc-9a6e-1fe707989836 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:20.700355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:20.703110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:20.703408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:20.704051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:20.715286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:20.716729 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:20.732889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 972/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:10:21.701190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:21.702793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:21.703254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:21.737734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] MFA Rules not processed for user `ff91d43c564b48c8a5c7869dba23d419`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:21.740652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:21.845910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 955/1927] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:21.853435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:21.864825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad96c-ee34-4862-b9d1-c3fb8106d9e2 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:21.870281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:21.871138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:21.871586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:21.872014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:21.873027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:21.875684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:21.915643 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:21.916007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 973/1928] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:21 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:21.928283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c48de-5605-4860-97fd-d9f1fc776c2e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.019153 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:22.048780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.049522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.049955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.050230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.050829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.053891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.097283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:22.108328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 956/1929] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:21 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:22.113324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1e448-8fe2-40cc-8005-de70538f7d86 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.120023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.121639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.121925 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.122197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.124042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.126340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7a98-192a-49a8-9561-9f6eeee58611 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.143995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 974/1930] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:22.148448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:22.160424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.160732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.161166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.162259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7aff-d77c-4e54-9d28-a321a4c607dd admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.167367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.168210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.175354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.175788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] PATH_INFO: `/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1/users/547911cb3f27434eb7f8f571e178de02/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.193200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:22.195247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:22.196015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c8b97949b14dc9bb01aefcb2f2e6e1, user_id=547911cb3f27434eb7f8f571e178de02, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.199158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.227818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 957/1931] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:22 2022] PUT /identity/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1/users/547911cb3f27434eb7f8f571e178de02/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:10:22.233165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:22.355251 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 975/1932] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:10:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:22.363622 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:22.364930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:22.401155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbddb3-57a9-4407-a5f6-261b708a62ad admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.411955 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.413302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.414130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.414484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.416165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.422006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.447124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 958/1933] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:22.449288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:22.469205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4531b-e644-41ed-81c1-b01a413fe08a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.474572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.475343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.475686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.476030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] PATH_INFO: `/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1/users/547911cb3f27434eb7f8f571e178de02/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.478499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c8b97949b14dc9bb01aefcb2f2e6e1, user_id=547911cb3f27434eb7f8f571e178de02, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.483527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fe916-8579-444e-970a-39cc9e87e575 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.488805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53981cc2-ce29-4d05-b0a6-d3660b8de349 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:22.499703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 959/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:22 2022] PUT /identity/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1/users/547911cb3f27434eb7f8f571e178de02/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:22.572588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:22.584801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:22.585811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:22.586605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:22.588085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:22.711117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:22.713738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ad37c-e808-4ae1-815d-a065f573cda3 service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:22.726263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 976/1935] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:10:23.842762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:23.843259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:23.843340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:23.914887 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] MFA Rules not processed for user `547911cb3f27434eb7f8f571e178de02`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:23.916726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:24.053855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 960/1936] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:24.069738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a538-985d-45bc-8787-314d655ece82 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:24.069738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a538-985d-45bc-8787-314d655ece82 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:24.069738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a538-985d-45bc-8787-314d655ece82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:24.110375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4b37a538-985d-45bc-8787-314d655ece82 None None] MFA Rules not processed for user `ff91d43c564b48c8a5c7869dba23d419`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:24.113187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4b37a538-985d-45bc-8787-314d655ece82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:24.239119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 977/1937] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:24.342512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:24.344521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:24.390096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:24.470848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3b206-28bb-4fa1-9af5-6ab69ed23ada None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:24.477296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:24.477930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:24.478213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:24.478558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:24.500565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:24.502489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:24.527476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 961/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:32.828484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:32.829004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:32.829004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:32.901098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] MFA Rules not processed for user `e471a36a66f54520ae2b4b2548e1d315`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:32.903100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:33.103663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 978/1939] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:33.108230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:33.278709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d970-0a8d-4105-8fbf-f5b7980faf62 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:33.290290 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:33.291120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:33.291411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:33.291684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:33.292348 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:33.303028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:33.377500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 962/1940] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:10:33 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:10:33.382120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:33.402511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e623a5a-0a2e-490d-9367-ca140a6e1330 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:33.459001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:33.513186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:33.514634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:33.514919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:33.516625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:33.518488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:33.536761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:33.581821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 979/1941] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:10:33 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:10:33.582576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:33.601241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf29-db7b-4aa8-9b4d-f2a99f9c8d83 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:33.626284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:33.626921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:33.627233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:33.627509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:33.628242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:33.629868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:33.646935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 963/1942] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:10:33.648181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:33.663954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a047b-786a-4bc0-92b9-cd77795818c7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:33.675162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:33.676185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:33.676463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:33.676741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] PATH_INFO: `/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c/users/1f375d18e2e34917972adec65b5a24c4/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:33.710633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df3c1d6206f40a1b2c1e155d7c3703c, user_id=1f375d18e2e34917972adec65b5a24c4, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:33.713930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:33.783307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 980/1943] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:33 2022] PUT /identity/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c/users/1f375d18e2e34917972adec65b5a24c4/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:10:33.785931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:33.809739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed58db-6afe-431f-a6d9-6faa55144314 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:34.036850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:34.036850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:34.036850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:34.036850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:34.037359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:34.064611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac59eb9-8d98-476b-84e2-da6dce7afd0e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:34.111044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:34.118361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 964/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:10:34.137648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7902-d823-4cd4-9599-ad202fc57149 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:34.143732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:34.146701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:34.147496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:34.148076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] PATH_INFO: `/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c/users/1f375d18e2e34917972adec65b5a24c4/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:34.152390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df3c1d6206f40a1b2c1e155d7c3703c, user_id=1f375d18e2e34917972adec65b5a24c4, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:34.157189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:34.179027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 981/1945] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:10:34 2022] PUT /identity/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c/users/1f375d18e2e34917972adec65b5a24c4/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:10:44.087685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:44.172122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=28,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:44.974305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c674d6-f65a-40ba-afe8-eac9bb41dd02 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:44.974599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c674d6-f65a-40ba-afe8-eac9bb41dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:44.974864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c674d6-f65a-40ba-afe8-eac9bb41dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:45.038797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-46c674d6-f65a-40ba-afe8-eac9bb41dd02 None None] MFA Rules not processed for user `1f375d18e2e34917972adec65b5a24c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:45.049724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-46c674d6-f65a-40ba-afe8-eac9bb41dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:45.308851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 965/1946] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:45.340276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:45.538655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53833b4-e054-4772-80cd-a08213906afe admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:45.558023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:45.559629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:45.560616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:45.561042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:45.659911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:45.661484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1c8c-edc6-423e-b83e-7908264cdafb service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:45.682222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 982/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:47.249435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e9a5-e7ab-4d62-83dd-18c99bb5ded2 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:47.250356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e9a5-e7ab-4d62-83dd-18c99bb5ded2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:47.250858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e9a5-e7ab-4d62-83dd-18c99bb5ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:47.280579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-9642e9a5-e7ab-4d62-83dd-18c99bb5ded2 None None] MFA Rules not processed for user `e471a36a66f54520ae2b4b2548e1d315`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:47.282008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-9642e9a5-e7ab-4d62-83dd-18c99bb5ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:47.290106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 966/1948] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:10:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:52.676684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:52.677266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:52.677266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:52.678555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 983/1949] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:10:52.684682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc390-7fec-47df-97f2-cdae4535ae29 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:52.685143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc390-7fec-47df-97f2-cdae4535ae29 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:52.685253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc390-7fec-47df-97f2-cdae4535ae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:52.708051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-682fc390-7fec-47df-97f2-cdae4535ae29 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:52.709309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-682fc390-7fec-47df-97f2-cdae4535ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:52.720318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 967/1950] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:10:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:52.733516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:52.735752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:52.815760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ff404-51e3-4ff2-8887-6b19fa587634 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:52.819854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:52.820480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:52.820828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:52.821111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:52.834795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:52.836374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab296-c44b-4565-8a12-557a986439a7 service glance] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:52.848835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 984/1951] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:52.925186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7922bc-217a-47b8-beb5-fed8fdd74992 None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:52.925561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7922bc-217a-47b8-beb5-fed8fdd74992 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:52.925780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7922bc-217a-47b8-beb5-fed8fdd74992 None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:52.927524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 968/1952] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:10:52.933928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e9e6-22f3-4e0c-9e4f-a8ff4f51168f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:52.934399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e9e6-22f3-4e0c-9e4f-a8ff4f51168f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:52.935319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e9e6-22f3-4e0c-9e4f-a8ff4f51168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:52.959220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fb01e9e6-22f3-4e0c-9e4f-a8ff4f51168f None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:52.960586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fb01e9e6-22f3-4e0c-9e4f-a8ff4f51168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:53.002810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:53.029225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 985/1953] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:10:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:53.046625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7922bc-217a-47b8-beb5-fed8fdd74992 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:53.062742 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7922bc-217a-47b8-beb5-fed8fdd74992 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:53.066485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:53.067095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:53.067389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:53.067659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:53.075249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:53.077407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886092d-6a67-480f-8725-d15157a739ed service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:53.085291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 969/1954] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:53.172096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee1c-59ff-4159-90cf-80e3508ec45a None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:53.172801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee1c-59ff-4159-90cf-80e3508ec45a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:53.173290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee1c-59ff-4159-90cf-80e3508ec45a None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:53.174851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 986/1955] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:10:53.181544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:53.185284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:53.185594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:53.206201 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:53.207441 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:53.218437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 970/1956] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:10:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:53.230100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ee1c-59ff-4159-90cf-80e3508ec45a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:53.241749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ee1c-59ff-4159-90cf-80e3508ec45a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:53.248555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:53.249089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:53.249369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:53.249638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:53.260619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:53.262135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da4d57-2d60-46a4-898b-65a4f8b35749 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:53.274623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 987/1957] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:54.394222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:54.395789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:54.454699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f196-afe8-4ce1-9193-c13663e573e7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:54.458863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:54.459029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:54.459312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:54.459590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:54.554919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:54.556492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:54.568508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 971/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:10:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:10:58.412504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:58.413172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:58.413172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:58.434187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:10:58.436101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:10:58.499651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 988/1959] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:10:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:10:58.513317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:10:58.518900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:10:58.592618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4b65c-bc11-469c-82db-7add1a8a83a6 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:10:58.598443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:10:58.599142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:10:58.599535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:10:58.599872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:10:58.610973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:10:58.612687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f605-2323-4dd6-aeed-5a69b4f44960 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:10:58.621332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 972/1960] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:10:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:11:08.492066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=36 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:08.617974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=31 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:09.288020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:09.289434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:09.359794 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24073-f763-48bd-a770-3448b2a83d89 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:09.365516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:09.366138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:09.366429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:09.366689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:09.368446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:09.379847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:09.381377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:09.392189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 989/1961] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:11:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:11:19.387649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=32 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:19.897737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:19.898249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:19.898401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:19.918590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:19.919839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:19.927326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 973/1962] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:11:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:11:19.940927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:19.952013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd102-a883-4720-a161-8ac2ced1e066 service placement] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:19.957060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:19.957657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:19.957932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:19.958200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:19.966330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:19.967926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:19.976721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 990/1963] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:11:25.199378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:25.211620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955d1ac-d35f-4696-a784-9350194ca852 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:25.215774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:25.216473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:25.216758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:25.217044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:25.226812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:25.228907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:25.239578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 974/1964] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:11:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:11:29.297255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:29.387502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb6ff-1705-489b-88ea-c2047fef6b6c service swift] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:29.392675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:29.393401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:29.393844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:29.394287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] PATH_INFO: `/v3/users/ff91d43c564b48c8a5c7869dba23d419` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:29.395483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff91d43c564b48c8a5c7869dba23d419)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:29.397403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:29.459526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff91d43c564b48c8a5c7869dba23d419'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.460279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff91d43c564b48c8a5c7869dba23d419'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.471825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff91d43c564b48c8a5c7869dba23d419'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.492450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff91d43c564b48c8a5c7869dba23d419'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.502234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff91d43c564b48c8a5c7869dba23d419'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.508755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 991/1965] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:11:29 2022] DELETE /identity/v3/users/ff91d43c564b48c8a5c7869dba23d419 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:29.688403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:29.701973 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423f0f-63ff-4b91-a419-f5861bc29831 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:29.779686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:29.780656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:29.781114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:29.781597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] PATH_INFO: `/v3/projects/f01223d5c5e745b78271f584abe0d298` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:29.783191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01223d5c5e745b78271f584abe0d298)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:29.785592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:29.868085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01223d5c5e745b78271f584abe0d298', 'request_id': 'req-74b22650-19eb-4342-84f4-2b79895c4037'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.885296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01223d5c5e745b78271f584abe0d298', 'request_id': 'req-74b22650-19eb-4342-84f4-2b79895c4037'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.907495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01223d5c5e745b78271f584abe0d298', 'request_id': 'req-74b22650-19eb-4342-84f4-2b79895c4037'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.923422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] The token cache is being invalidate because project f01223d5c5e745b78271f584abe0d298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:11:29.923946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.924882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:29.927280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 975/1966] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:11:29 2022] DELETE /identity/v3/projects/f01223d5c5e745b78271f584abe0d298 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:29.931038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:29.932871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:29.948417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77d05-a550-439b-94c1-c0e1d8fa4b6b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:30.046759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:30.048294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.048644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.048994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] PATH_INFO: `/v3/users/547911cb3f27434eb7f8f571e178de02` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.050227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547911cb3f27434eb7f8f571e178de02)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:30.052278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:30.059006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:30.106642 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547911cb3f27434eb7f8f571e178de02'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.107354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547911cb3f27434eb7f8f571e178de02'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.115911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547911cb3f27434eb7f8f571e178de02'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.137019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547911cb3f27434eb7f8f571e178de02'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.157703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-b82a09d8-97a9-40e3-871f-163bc3b6a259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547911cb3f27434eb7f8f571e178de02'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.165820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 992/1967] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:11:29 2022] DELETE /identity/v3/users/547911cb3f27434eb7f8f571e178de02 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:11:30.385711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:30.387321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:30.406869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b22650-19eb-4342-84f4-2b79895c4037 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:30.532454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:30.533212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.533556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.533911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] PATH_INFO: `/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.535129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c8b97949b14dc9bb01aefcb2f2e6e1)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:30.538534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:30.551304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:30.598104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c8b97949b14dc9bb01aefcb2f2e6e1', 'request_id': 'req-4d9334cd-ea9f-4436-a24a-ad687bf3b610'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.606512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c8b97949b14dc9bb01aefcb2f2e6e1', 'request_id': 'req-4d9334cd-ea9f-4436-a24a-ad687bf3b610'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.613996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c8b97949b14dc9bb01aefcb2f2e6e1', 'request_id': 'req-4d9334cd-ea9f-4436-a24a-ad687bf3b610'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.626565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] The token cache is being invalidate because project 23c8b97949b14dc9bb01aefcb2f2e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:11:30.626858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.627625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4d9334cd-ea9f-4436-a24a-ad687bf3b610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:30.629155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 976/1968] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:11:30 2022] DELETE /identity/v3/projects/23c8b97949b14dc9bb01aefcb2f2e6e1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:30.634190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.634722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.634722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.656650 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:30.658120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:30.725299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 993/1969] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:11:30.733901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.734435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.734739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.755829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:30.757244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:30.766567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 977/1970] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:11:30.770905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:30.781474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6be0-5d37-4a3e-8c7a-85a77fde1ba1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:30.786253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:30.786871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.787178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.787451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.788101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:11:30.788402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:30.789984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:30.804572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 994/1971] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:11:30.808865 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:30.818720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9556-ea3a-4d61-ae5e-b7a1504c0262 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:30.824830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:30.825435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.825729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.826019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.826658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:30.828583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:30.858975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 978/1972] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:11:30.863272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:30.873640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b60-0f7f-41b2-a9a5-46ae2b58e424 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:30.949202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:30.950833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:30.951546 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:30.951905 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:30.952978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:30.955869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.020030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 995/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:11:30 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:11:31.021120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.032633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a194487-f689-49f3-bcb4-060d4dc58f0d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.038941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.039611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.039890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.040158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.040816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.042475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.058919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 979/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:11:31.062396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.068016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:31.076596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714e990-8b1b-4e00-a234-791a797afae3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.086781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.093317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.093760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.094131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.094945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.097083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe025c-73b0-4cd2-aafa-2cbff53e1b08 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.135694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 996/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:11:31.140367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.164882 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b6766-8b6f-42b7-a29b-67a5fa105dde admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.171369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.172485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.172858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.173228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] PATH_INFO: `/v3/projects/3dc43c236bee42bd891f38b36a40149e/users/07e30f05adab48768ee980beeaaf99b2/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.196246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc43c236bee42bd891f38b36a40149e, user_id=07e30f05adab48768ee980beeaaf99b2, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.199793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.218786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 980/1976] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:11:31 2022] PUT /identity/v3/projects/3dc43c236bee42bd891f38b36a40149e/users/07e30f05adab48768ee980beeaaf99b2/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:31.229814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.230133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.230409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.271679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] MFA Rules not processed for user `07e30f05adab48768ee980beeaaf99b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:31.273120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:31.349881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 997/1977] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:11:31.361130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.362832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:31.425034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5873-1bec-4a45-a8cd-4ed39a183006 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.429687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.430812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.431115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.431394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.442214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.443614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235020c-26d7-484e-af20-0e58563feab3 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.457884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 981/1978] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:11:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:11:31.488244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.562491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc1786-41c6-4669-9e63-2896363f7fa6 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.567028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.567688 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.567970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.568246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] PATH_INFO: `/v3/users/07e30f05adab48768ee980beeaaf99b2` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.569455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e30f05adab48768ee980beeaaf99b2)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.571329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.619177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e30f05adab48768ee980beeaaf99b2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:31.619847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e30f05adab48768ee980beeaaf99b2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:31.627272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e30f05adab48768ee980beeaaf99b2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:31.639754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e30f05adab48768ee980beeaaf99b2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:31.646482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e30f05adab48768ee980beeaaf99b2'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:31.648607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:31.653521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 998/1979] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:11:31 2022] DELETE /identity/v3/users/07e30f05adab48768ee980beeaaf99b2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:31.658108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.658394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.658668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.677984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:31.679209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:31.712208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:31.738136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 982/1980] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:11:31.749044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:31.750438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:31.807810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cea44-4490-442b-a742-b2e722473433 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:31.812073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:31.812689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:31.812953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:31.813227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:31.822961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:31.824374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f176e36-6997-4948-9b0e-812c4925be59 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:31.834663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 999/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:11:32.119576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:11:32.121864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:32.134778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f906-110a-4aca-92f5-bda3519d0c4a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:11:32.141231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:11:32.142092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:32.142525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:32.143023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] PATH_INFO: `/v3/projects/3dc43c236bee42bd891f38b36a40149e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:32.148554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc43c236bee42bd891f38b36a40149e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:11:32.151311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:11:32.205625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc43c236bee42bd891f38b36a40149e', 'request_id': 'req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:32.221381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc43c236bee42bd891f38b36a40149e', 'request_id': 'req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:32.227822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc43c236bee42bd891f38b36a40149e', 'request_id': 'req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:32.239892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] The token cache is being invalidate because project 3dc43c236bee42bd891f38b36a40149e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:11:32.240180 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:32.240830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-1208d8ef-e642-44ec-9ce6-1b16f8b863c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:11:32.242318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 983/1982] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:11:32 2022] DELETE /identity/v3/projects/3dc43c236bee42bd891f38b36a40149e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:11:39.620400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cc35-0a33-4b27-857e-547faa03020c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:39.620890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cc35-0a33-4b27-857e-547faa03020c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:39.621005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942cc35-0a33-4b27-857e-547faa03020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:39.640133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8942cc35-0a33-4b27-857e-547faa03020c None None] MFA Rules not processed for user `a925c18e67894c06863e68b2793488d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:39.641349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8942cc35-0a33-4b27-857e-547faa03020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:39.697255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1000/1983] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:11:42.236775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:49.690382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=51 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:11:59.642456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:11:59.642927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:11:59.643058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:11:59.663003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] MFA Rules not processed for user `a8eddc1a05c14b26acaf7997784f9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:11:59.665557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:11:59.728200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 984/1984] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:11:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:12:08.151455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:08.152480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:08.152480 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:08.172996 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:12:08.174663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:08.230723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1001/1985] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:12:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:12:08.254058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:12:08.255526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:08.326292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819b2e-84f2-476d-9b97-4f4e8fedf2ce None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:12:08.331140 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:12:08.331773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:08.332046 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:08.332317 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:08.340223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:12:08.341797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:12:08.349742 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 985/1986] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:12:15.768143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:12:15.769886 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:15.945084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce1c5-a0ef-41b0-99bf-8043ebbee73d None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:12:15.950706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:12:15.951868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:15.951868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:15.952104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] PATH_INFO: `/v3/users/4a4c9498d13d451a80522437aff25237` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:15.953166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4c9498d13d451a80522437aff25237)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:12:15.955185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:12:16.007011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4c9498d13d451a80522437aff25237'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.007760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4c9498d13d451a80522437aff25237'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.020202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4c9498d13d451a80522437aff25237'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.033745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4c9498d13d451a80522437aff25237'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.042034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4c9498d13d451a80522437aff25237'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.050345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1002/1987] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:12:15 2022] DELETE /identity/v3/users/4a4c9498d13d451a80522437aff25237 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:12:16.250772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:12:16.262782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3163fb7-f5bb-4458-a9ae-e6b29eb0a45b service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:12:16.323186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:12:16.324530 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:16.324907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:16.325275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] PATH_INFO: `/v3/projects/9bca9295155c41c88e9e883980e345f1` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:16.326795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bca9295155c41c88e9e883980e345f1)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:12:16.329351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:12:16.372572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:16.382455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bca9295155c41c88e9e883980e345f1', 'request_id': 'req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.390108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bca9295155c41c88e9e883980e345f1', 'request_id': 'req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.395685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bca9295155c41c88e9e883980e345f1', 'request_id': 'req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.406820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] The token cache is being invalidate because project 9bca9295155c41c88e9e883980e345f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:12:16.407143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.407778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.409272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 986/1988] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:12:16 2022] DELETE /identity/v3/projects/9bca9295155c41c88e9e883980e345f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:12:16.413315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:12:16.414752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:16.428026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611bc1-191b-41fa-b614-eebd72a0ac58 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:12:16.448232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:16.486184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:12:16.486819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:16.487121 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:16.487395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] PATH_INFO: `/v3/users/44c1b763cdfc4f7ea1044db80c76c6b1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:16.488504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c1b763cdfc4f7ea1044db80c76c6b1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:12:16.490406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:12:16.538270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c1b763cdfc4f7ea1044db80c76c6b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.538952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c1b763cdfc4f7ea1044db80c76c6b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.547779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c1b763cdfc4f7ea1044db80c76c6b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.560397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c1b763cdfc4f7ea1044db80c76c6b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.567138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac4535dd-2d13-4a6e-896f-ee9dac6112e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c1b763cdfc4f7ea1044db80c76c6b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.572926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1003/1989] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:12:16 2022] DELETE /identity/v3/users/44c1b763cdfc4f7ea1044db80c76c6b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:12:16.747787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:12:16.749274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:16.763401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3952bc-82c8-4c88-ad54-0e3e94dd1be4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:12:16.821181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:12:16.821807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:16.822086 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:16.822358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] PATH_INFO: `/v3/projects/0712f4973a2b4b6cb3df9016bb94581f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:16.823541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0712f4973a2b4b6cb3df9016bb94581f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:12:16.825462 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:12:16.874618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0712f4973a2b4b6cb3df9016bb94581f', 'request_id': 'req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.882007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0712f4973a2b4b6cb3df9016bb94581f', 'request_id': 'req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.888326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0712f4973a2b4b6cb3df9016bb94581f', 'request_id': 'req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.900101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] The token cache is being invalidate because project 0712f4973a2b4b6cb3df9016bb94581f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:12:16.900389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.901044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-19a7e420-c6f1-4d64-ac6b-4691b6e7edbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:12:16.903088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 987/1990] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:12:16 2022] DELETE /identity/v3/projects/0712f4973a2b4b6cb3df9016bb94581f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:12:18.816302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602866c-5a0e-45b5-9fad-63d7baf9e660 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:18.816802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602866c-5a0e-45b5-9fad-63d7baf9e660 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:18.816918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602866c-5a0e-45b5-9fad-63d7baf9e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:18.837440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-e602866c-5a0e-45b5-9fad-63d7baf9e660 None None] MFA Rules not processed for user `5ba37660a05e44f5a7f10946e79cb250`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:12:18.838624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e602866c-5a0e-45b5-9fad-63d7baf9e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:18.893901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1004/1991] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:12:26.897073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:28.887359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:12:55.738531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:55.739117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:55.739218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:55.760052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] MFA Rules not processed for user `db8a7662772f4ac69378d3f33e5e6098`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:12:55.761266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:55.817169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 988/1992] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:12:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:12:56.028282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:12:56.028892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:12:56.029067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:12:56.051737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] MFA Rules not processed for user `a925c18e67894c06863e68b2793488d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:12:56.053063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:12:56.117312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1005/1993] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:12:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:05.810531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=25 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:06.108505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=25 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:10.653818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:10.655267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:10.710507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b6e33-639d-4f7f-ab49-230840316988 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:10.714448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:10.714792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:10.715080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:10.715372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:10.717697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:10.785181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:10.786612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:10.797093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 989/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:15.286061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:15.288203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:15.369998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:15.372816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:15.393625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f82b3-204a-42f9-a21b-97d85d7fc13e service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:15.398418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c6e5-e6df-4d97-8a0f-00008a62c0f8 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:15.404770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:15.406390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:15.406797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:15.407204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:15.409718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:15.419544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:15.421938 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:15.423208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:15.425597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] PATH_INFO: `/v3/users/a8eddc1a05c14b26acaf7997784f9d0d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:15.428809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:15.430604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8eddc1a05c14b26acaf7997784f9d0d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:15.430955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:15.436675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:15.445405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1006/1995] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:15.514077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8eddc1a05c14b26acaf7997784f9d0d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.522490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8eddc1a05c14b26acaf7997784f9d0d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.533177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8eddc1a05c14b26acaf7997784f9d0d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.546818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8eddc1a05c14b26acaf7997784f9d0d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.547559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-65c83d37-fe4b-4392-9ccd-9a36ab2ba7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8eddc1a05c14b26acaf7997784f9d0d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.553468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 990/1996] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:15 2022] DELETE /identity/v3/users/a8eddc1a05c14b26acaf7997784f9d0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:15.758322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:15.771504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ac559-c886-4f4c-8b0d-a659881fa95c service placement] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:15.832318 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:15.832959 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:15.833238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:15.833513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] PATH_INFO: `/v3/projects/a08d8f10be91431fa9c0fe51e953f28a` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:15.834660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08d8f10be91431fa9c0fe51e953f28a)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:15.836594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:15.883922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08d8f10be91431fa9c0fe51e953f28a', 'request_id': 'req-fcbee956-69a4-4cd8-9a31-07103f14e916'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.889452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08d8f10be91431fa9c0fe51e953f28a', 'request_id': 'req-fcbee956-69a4-4cd8-9a31-07103f14e916'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.896040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08d8f10be91431fa9c0fe51e953f28a', 'request_id': 'req-fcbee956-69a4-4cd8-9a31-07103f14e916'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.908346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] The token cache is being invalidate because project a08d8f10be91431fa9c0fe51e953f28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:15.908634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.909249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-fcbee956-69a4-4cd8-9a31-07103f14e916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:15.910784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1007/1997] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:15 2022] DELETE /identity/v3/projects/a08d8f10be91431fa9c0fe51e953f28a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:15.916811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:15.917105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:15.917385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:15.938273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:15.939514 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:15.956108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:16.000531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 991/1998] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:16.008421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.008708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.008983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.028655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:16.029861 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:16.037944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1008/1999] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:16.042278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.052493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6af0-29ee-4c8c-9abb-1197a7a0123c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.057026 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.057633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.057908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.058177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.058817 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:13:16.059148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.061306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.073157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 992/2000] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:13:16.076758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.077370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.078386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:16.087308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0d9c-f52c-4a4c-8902-762addfa9d05 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.092663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.093249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:16.093369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.093533 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.093811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.094439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.096568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.126193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 993/2001] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:16 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:16.130062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.140846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6e5c-0950-40fd-88f2-774d95fe8fad None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.196736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd765-f16d-4954-a0fd-54cc00ce0017 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.199425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.200899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.201185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.201457 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.202979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.203295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:16.203731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.204014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.204292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.205024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.207177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.234519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 994/2002] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:16 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:16.238445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.248930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765e03-52ae-466c-b494-40ae474539a2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.253909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.254552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.255031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.255410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.256145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.257802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.269392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 995/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:13:16.274072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.287264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221983-84bf-4c1b-8d04-a901d1a3b786 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.292185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.292989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.293578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.293861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.294507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.296605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.299277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.300997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb17a1-dc78-4bb8-bb7f-15d3c97baa4c service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.309023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 996/2004] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:13:16.313747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.314382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1009/2005] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:13:16.328126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385becf-3d66-4362-adaf-509bd1e5665c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.333115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.333866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.334215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.334560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] PATH_INFO: `/v3/projects/c13f1ad96e6f490f83a27fc82e444a58/users/be8ab298577e4fc6b2e0ede874805813/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.353875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f1ad96e6f490f83a27fc82e444a58, user_id=be8ab298577e4fc6b2e0ede874805813, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.358113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.372257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 997/2006] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:16 2022] PUT /identity/v3/projects/c13f1ad96e6f490f83a27fc82e444a58/users/be8ab298577e4fc6b2e0ede874805813/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:16.382697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.382977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.383276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.415772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] MFA Rules not processed for user `be8ab298577e4fc6b2e0ede874805813`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:16.417324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:16.492947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:16.499413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1010/2007] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:16.514618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:16.522366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:16.571811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:16.600184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e018-9bbd-453e-bb7f-4e7ff928e633 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:16.604494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:16.605211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:16.605552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:16.605912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:16.614607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:16.616058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:16.625234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 998/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:18.503289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:18.504846 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:18.579914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7435e-f6d5-41a9-a726-d5c4ab661235 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:18.583539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:18.584157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:18.584436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:18.584710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:18.586615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:18.669541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:18.670868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:18.681924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1011/2009] 10.222.0.20 () {60 vars in 1396 bytes} [Sun Oct 23 00:13:18 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:23.510241 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:23.519857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516413f-4b05-4e48-b975-a354cbc33a6d service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:23.523496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:23.524121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:23.524398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:23.524669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:23.526384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:23.596352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:23.597772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd939be-0b98-4db8-a92b-93ca334dcae6 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:23.609100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 999/2010] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:25.189808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:25.251010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8058-7aba-4f23-8f1b-588fda410db6 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:25.255745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:25.256644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.256922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.257237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] PATH_INFO: `/v3/users/be8ab298577e4fc6b2e0ede874805813` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.258460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8ab298577e4fc6b2e0ede874805813)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:25.260383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:25.308335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8ab298577e4fc6b2e0ede874805813'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.308972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8ab298577e4fc6b2e0ede874805813'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.316057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8ab298577e4fc6b2e0ede874805813'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.318244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:25.330569 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8ab298577e4fc6b2e0ede874805813'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.337334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8ab298577e4fc6b2e0ede874805813'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.343694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1012/2011] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:25 2022] DELETE /identity/v3/users/be8ab298577e4fc6b2e0ede874805813 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:25.348179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.348631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.348739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.367910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:25.369111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:25.427103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1000/2012] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:25.436748 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:25.438194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:25.495019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fefe9-0d8c-41d8-9ba3-10b9d0cf1569 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:25.498624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:25.499262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.499539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.499809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.508658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:25.510064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7a13b-df21-44da-bed7-5302dbb0e111 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:25.520162 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1013/2013] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:25.780825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:25.782238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:25.797313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275dae-99ba-4aba-b993-5b85d84fb2df None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:25.802940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:25.803619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.803896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.804171 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] PATH_INFO: `/v3/projects/c13f1ad96e6f490f83a27fc82e444a58` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.805311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13f1ad96e6f490f83a27fc82e444a58)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:25.807260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:25.854308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13f1ad96e6f490f83a27fc82e444a58', 'request_id': 'req-89089d4c-15f6-4211-8405-df92cf7ac8cb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.858438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:25.863148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13f1ad96e6f490f83a27fc82e444a58', 'request_id': 'req-89089d4c-15f6-4211-8405-df92cf7ac8cb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.870193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13f1ad96e6f490f83a27fc82e444a58', 'request_id': 'req-89089d4c-15f6-4211-8405-df92cf7ac8cb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.882003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] The token cache is being invalidate because project c13f1ad96e6f490f83a27fc82e444a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:25.882287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.882943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-89089d4c-15f6-4211-8405-df92cf7ac8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:25.884450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1001/2014] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:25 2022] DELETE /identity/v3/projects/c13f1ad96e6f490f83a27fc82e444a58 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:25.889287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.889562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.889836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.909299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:25.910484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:25.970493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1014/2015] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:25.978194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:25.978585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:25.978930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:25.999781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:26.000999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:26.008971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1002/2016] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:26.013229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.024035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8650fc-fb1c-4411-b7f2-db631abd8809 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.029108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.029764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.030038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.030308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.030954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:13:26.031285 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.032889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.045077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1015/2017] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:13:26.049788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.059251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c6e1-1514-4ee7-a5f4-55755d76da20 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.064493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.065102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.065382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.065657 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.066318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.068597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.096628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1003/2018] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:26.100734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.110514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e34924-5e6a-4d59-ae53-5452ee7ba47c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.165705 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.166299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.166577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.166847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.167505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.169459 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.179438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:26.195521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1016/2019] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:26.196720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.207824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8342b2-4920-474f-aa9e-f55f793785c5 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.212586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.213237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.213616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.213832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.214515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.216118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.226414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1004/2020] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:26.230475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.240811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41067e-03ca-4b42-b761-50d7fa5fffd8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.245360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.245947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.246222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.246496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.247157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.249264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a074cd-056e-4edb-9672-0c1d8ace34cf admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.259692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1017/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:26.263584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.274106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1105d2-9d4b-4603-976a-9f9273950348 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.278727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.279405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.279690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.279964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] PATH_INFO: `/v3/projects/218b9ba69f254ef698d1391605756604/users/4c8a092c21bf43bfa3882fb7270996dd/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.294681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218b9ba69f254ef698d1391605756604, user_id=4c8a092c21bf43bfa3882fb7270996dd, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.298143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.311760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1005/2022] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:26 2022] PUT /identity/v3/projects/218b9ba69f254ef698d1391605756604/users/4c8a092c21bf43bfa3882fb7270996dd/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:26.322049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.322368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.322640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.349663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] MFA Rules not processed for user `4c8a092c21bf43bfa3882fb7270996dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:26.350953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:26.414699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1018/2023] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:26.419438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.480665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fba55-31eb-4726-82a2-60b285d95593 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.485706 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.486305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.486586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.486890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.487554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.489456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.516167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1006/2024] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:26.520161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.531501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb91793-c68f-4587-bec7-c93eedd8460a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.586854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.587492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.587769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.588042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.588662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.590602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.612848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1019/2025] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:26.616867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.627628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253269-db75-4ce6-8dc9-1f418b54dd00 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.632218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.632814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.633095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.633370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.634036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.635659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.646248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1007/2026] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:26.650241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.660509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d1b08-8e2e-47b5-8ba0-53adfd915bba admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.664974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.665555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.665830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.666102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.666754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.668334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3de30-7a6e-4f4b-a9ac-723db1265f2e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.679122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1020/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:13:26.683004 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.692733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9b7f-9fc8-42c8-8562-46daf0d47915 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.697804 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.698443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.698724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.699000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] PATH_INFO: `/v3/projects/bb78ec2f72474a7dbc3430e5abf0d5ef/users/0418dd1d6b6f4a33b63cf6ccf1e14bad/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.713846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb78ec2f72474a7dbc3430e5abf0d5ef, user_id=0418dd1d6b6f4a33b63cf6ccf1e14bad, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.716538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.729283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1008/2028] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:26 2022] PUT /identity/v3/projects/bb78ec2f72474a7dbc3430e5abf0d5ef/users/0418dd1d6b6f4a33b63cf6ccf1e14bad/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:26.741477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.741782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.742060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.768904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] MFA Rules not processed for user `0418dd1d6b6f4a33b63cf6ccf1e14bad`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:26.770086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:26.811438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:26.839087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1021/2029] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:26.844313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.876695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:26.907958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ffcd-f611-40b7-b474-6fd748c72e44 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:26.912598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:26.913206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:26.913479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:26.913748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:26.914414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:26.916342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:26.944190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1009/2030] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:26.948373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:26.958788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d6741-2732-4bb9-bd54-45f258a2e61d None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.015424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.015943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.016223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.016494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.017128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.019017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.041266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1022/2031] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:26 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:27.045331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.055708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aca35-3547-4710-8c59-10eb9a671c9c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.060292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.060915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.061189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.061459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.062087 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.063693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.073422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1010/2032] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:27.077648 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.087392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f3327-04f6-4b86-a9b0-6344355cf381 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.092571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.093221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.093503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.093782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] PATH_INFO: `/v3/projects/d1d073d475a24c33b1424f7aeb91dae1/users/8590b4710c0e405cb2281cabde694ccc/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.108641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d073d475a24c33b1424f7aeb91dae1, user_id=8590b4710c0e405cb2281cabde694ccc, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.111643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.125411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1023/2033] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:27 2022] PUT /identity/v3/projects/d1d073d475a24c33b1424f7aeb91dae1/users/8590b4710c0e405cb2281cabde694ccc/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:27.129335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.139852 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad3fb7-caf8-4318-988d-daafe5793d2b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.197264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.197877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.198159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.198424 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.199054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.200649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06206-00c5-4d62-842e-267b74d72457 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.211685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1011/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:27.215849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.228065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b939ab8-daf8-40db-8af9-7322cae8bfb8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.233660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.234336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.234570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.234923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] PATH_INFO: `/v3/projects/d1d073d475a24c33b1424f7aeb91dae1/users/8590b4710c0e405cb2281cabde694ccc/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.236914 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d073d475a24c33b1424f7aeb91dae1, user_id=8590b4710c0e405cb2281cabde694ccc, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.239618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.250795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1024/2035] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:27 2022] PUT /identity/v3/projects/d1d073d475a24c33b1424f7aeb91dae1/users/8590b4710c0e405cb2281cabde694ccc/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:27.261049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.261332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.261612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.291201 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] MFA Rules not processed for user `8590b4710c0e405cb2281cabde694ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:27.292380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:27.358984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1012/2036] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:27.369738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.371483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:27.428738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b2f99-6ea1-468f-94d2-abf23c40d6a4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.432383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.432961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.433240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.433514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.442783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:27.444219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:27.454076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1025/2037] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:27.942981 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:27.944425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:27.955905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25717-2a8d-476f-a444-3729cb59d10b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:27.959443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:27.960033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:27.960304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:27.960569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:27.980534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:28.016953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:28.018368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:28.027048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1013/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:32.060045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:32.069243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d520f-21f4-41ce-9f90-ac76c66cf003 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:32.072896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:32.073518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:32.073796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:32.074069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:32.106315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:32.131175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:32.132590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ddd65-6d4f-464c-8c04-71857a7b5489 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:32.142195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1026/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:34.190042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:34.254283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10132-1b19-419e-aa89-3b506242494a service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:34.259469 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500457a-f631-402a-b124-badf13363588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:34.260165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500457a-f631-402a-b124-badf13363588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:34.260444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500457a-f631-402a-b124-badf13363588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:34.260715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500457a-f631-402a-b124-badf13363588 admin admin] PATH_INFO: `/v3/users/4c8a092c21bf43bfa3882fb7270996dd` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:34.261889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500457a-f631-402a-b124-badf13363588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8a092c21bf43bfa3882fb7270996dd)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:34.263917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500457a-f631-402a-b124-badf13363588 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:34.315364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8a092c21bf43bfa3882fb7270996dd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.322316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8a092c21bf43bfa3882fb7270996dd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.329419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8a092c21bf43bfa3882fb7270996dd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.341405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8a092c21bf43bfa3882fb7270996dd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.342094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8a092c21bf43bfa3882fb7270996dd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.348565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1014/2040] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:34 2022] DELETE /identity/v3/users/4c8a092c21bf43bfa3882fb7270996dd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:34.352904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:34.353356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:34.353474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:34.372983 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:34.374205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:34.431484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1027/2041] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:34.441433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:34.442854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:34.488735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:34.503104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500457a-f631-402a-b124-badf13363588 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:34.506695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:34.507328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:34.507599 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:34.507867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:34.517163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:34.518572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:34.528269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1015/2042] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:13:34.792429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:34.793953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:34.807193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ec188-d67c-4376-9ff3-f0cddd550aa1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:34.811964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:34.813706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:34.814017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:34.814335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] PATH_INFO: `/v3/projects/218b9ba69f254ef698d1391605756604` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:34.815482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218b9ba69f254ef698d1391605756604)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:34.817386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:34.864695 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218b9ba69f254ef698d1391605756604', 'request_id': 'req-a045e720-2a8f-40ce-ab56-568dbe436127'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.870294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218b9ba69f254ef698d1391605756604', 'request_id': 'req-a045e720-2a8f-40ce-ab56-568dbe436127'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.877109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218b9ba69f254ef698d1391605756604', 'request_id': 'req-a045e720-2a8f-40ce-ab56-568dbe436127'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.889921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] The token cache is being invalidate because project 218b9ba69f254ef698d1391605756604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:34.890206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.890823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:34.892320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1028/2043] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:34 2022] DELETE /identity/v3/projects/218b9ba69f254ef698d1391605756604 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:34.896378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:34.906313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510fb1-d92a-4913-84a4-c4b46e57a74e service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:34.961495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:34.962116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:34.962390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:34.962659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] PATH_INFO: `/v3/users/0418dd1d6b6f4a33b63cf6ccf1e14bad` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:34.963779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0418dd1d6b6f4a33b63cf6ccf1e14bad)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:34.965684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:35.010323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0418dd1d6b6f4a33b63cf6ccf1e14bad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.018708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0418dd1d6b6f4a33b63cf6ccf1e14bad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.026848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0418dd1d6b6f4a33b63cf6ccf1e14bad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.038952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0418dd1d6b6f4a33b63cf6ccf1e14bad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.039634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0418dd1d6b6f4a33b63cf6ccf1e14bad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.045577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1016/2044] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:34 2022] DELETE /identity/v3/users/0418dd1d6b6f4a33b63cf6ccf1e14bad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:35.316084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:35.317517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:35.338022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045e720-2a8f-40ce-ab56-568dbe436127 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:35.387944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:35.394732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:35.395626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:35.396283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:35.396583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] PATH_INFO: `/v3/projects/bb78ec2f72474a7dbc3430e5abf0d5ef` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:35.398470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb78ec2f72474a7dbc3430e5abf0d5ef)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:35.401344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:35.450471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb78ec2f72474a7dbc3430e5abf0d5ef', 'request_id': 'req-ae640089-e1e5-4082-8fb3-8bfd22763e28'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.456068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb78ec2f72474a7dbc3430e5abf0d5ef', 'request_id': 'req-ae640089-e1e5-4082-8fb3-8bfd22763e28'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.462303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb78ec2f72474a7dbc3430e5abf0d5ef', 'request_id': 'req-ae640089-e1e5-4082-8fb3-8bfd22763e28'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.476711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] The token cache is being invalidate because project bb78ec2f72474a7dbc3430e5abf0d5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:35.477005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.477663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.479422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1029/2045] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:35 2022] DELETE /identity/v3/projects/bb78ec2f72474a7dbc3430e5abf0d5ef => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:35.483874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:35.485278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:35.497962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d746-d33f-4220-95a3-5ebd9c70ec1c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:35.559295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:35.560002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:35.560347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:35.560683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] PATH_INFO: `/v3/users/8590b4710c0e405cb2281cabde694ccc` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:35.562489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8590b4710c0e405cb2281cabde694ccc)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:35.564414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:35.569016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:35.613476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8590b4710c0e405cb2281cabde694ccc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.620516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8590b4710c0e405cb2281cabde694ccc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.627639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8590b4710c0e405cb2281cabde694ccc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.639752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8590b4710c0e405cb2281cabde694ccc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.640382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-b7e7b7bf-e047-4f5a-93ec-2c7385703e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8590b4710c0e405cb2281cabde694ccc'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:35.646227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1017/2046] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:35 2022] DELETE /identity/v3/users/8590b4710c0e405cb2281cabde694ccc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:35.915736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:35.917286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:35.930833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae640089-e1e5-4082-8fb3-8bfd22763e28 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:35.987165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:35.987798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:35.988077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:35.988356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] PATH_INFO: `/v3/projects/d1d073d475a24c33b1424f7aeb91dae1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:35.989452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d073d475a24c33b1424f7aeb91dae1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:35.991371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.038102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d073d475a24c33b1424f7aeb91dae1', 'request_id': 'req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:36.043496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d073d475a24c33b1424f7aeb91dae1', 'request_id': 'req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:36.049809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d073d475a24c33b1424f7aeb91dae1', 'request_id': 'req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:36.062058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] The token cache is being invalidate because project d1d073d475a24c33b1424f7aeb91dae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:36.062346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:36.062969 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-6b3a78d7-51bd-43a1-863e-bdbe5c5f1e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:36.064495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1030/2047] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:35 2022] DELETE /identity/v3/projects/d1d073d475a24c33b1424f7aeb91dae1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:36.070511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.070797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.071090 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.091960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:36.093703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:36.150748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1018/2048] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:36.159826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.160106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.160378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.180043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:36.181227 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:36.189280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1031/2049] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:36.193451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.203357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c96445-699a-4aff-a3ae-920fa98a3320 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.207912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.208497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.208768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.209035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.209668 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:13:36.209966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.211602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.223544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1019/2050] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:13:36.227721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.236739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4f753-2a2c-4d8f-85f3-acdc9f2a077a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.241425 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.242037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.242317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.242608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.243254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.245128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.254376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:36.275130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1032/2051] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:36.281412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.292678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d09a-f993-4a4d-b8c9-acc53e03be0e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.348229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.348834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.349113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.349385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.350007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.351953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.368116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:36.375247 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1020/2052] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:36.378306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.388426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca3ff-6a10-4ffb-aece-9db10877b2e1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.393490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.394071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.394344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.394612 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.395273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.396866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.407084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1033/2053] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:36.410983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.421262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bfb12-b96e-43b7-b7d1-71895d2f1dbb admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.425899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.426510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.426790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.427182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.427826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.429528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94994bbf-4aa1-4b21-b708-4a433ef6d10b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.444343 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1021/2054] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:36.445657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.456494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ba734-9c52-4222-a595-d05643b368e0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.461848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.462733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.463119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.463518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] PATH_INFO: `/v3/projects/ac8aa782a9374e5fb029f8dd1c2eabd8/users/806f6ca72c9d46789bc0c5832cdab381/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.480168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8aa782a9374e5fb029f8dd1c2eabd8, user_id=806f6ca72c9d46789bc0c5832cdab381, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.482874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.496495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1034/2055] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:36 2022] PUT /identity/v3/projects/ac8aa782a9374e5fb029f8dd1c2eabd8/users/806f6ca72c9d46789bc0c5832cdab381/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:36.510342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.510889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.510889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.556779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] MFA Rules not processed for user `806f6ca72c9d46789bc0c5832cdab381`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:36.557966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:36.631347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1022/2056] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:36.635796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.720548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ef4be-f415-4176-860a-90d784b426c9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.726680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.727379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.727852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.728141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.729016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.732186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.767110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1035/2057] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:36.769266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.780193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039007fd-cdf9-449c-aeb0-199f21fa8736 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.836588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.837202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.837477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.837744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.838374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.840299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.864545 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1023/2058] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:36 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:36.865735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.877043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e9f8-a013-443e-8095-9f50323ae687 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.881827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.882455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.882732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.883004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.883678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.885271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.896046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1036/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:36.900335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.910258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e42f-4e56-4594-9333-1c0cc000088b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:36.914913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:36.915671 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:36.915924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:36.916193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] PATH_INFO: `/v3/projects/7f9bdbda06c640bf99a449439cff0911/users/c2c78da47ffb426888b5f0ec3fa2a98f/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:36.932812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9bdbda06c640bf99a449439cff0911, user_id=c2c78da47ffb426888b5f0ec3fa2a98f, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:36.935511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:36.949229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1024/2060] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:36 2022] PUT /identity/v3/projects/7f9bdbda06c640bf99a449439cff0911/users/c2c78da47ffb426888b5f0ec3fa2a98f/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:36.953255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:36.964798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f13a-d3f2-458e-8072-1c9933c30912 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:37.029800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:37.030444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.030730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.031004 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.032009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:37.033785 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fb0a-3a69-4f2a-8982-9f7c5d8c8701 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:37.047496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1037/2061] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:37.051903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:37.064813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a531a-3be5-4e90-9634-ae1feeb56db0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:37.069619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:37.070283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.070565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.070840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] PATH_INFO: `/v3/projects/7f9bdbda06c640bf99a449439cff0911/users/c2c78da47ffb426888b5f0ec3fa2a98f/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.071238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.071664 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.072095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.072960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9bdbda06c640bf99a449439cff0911, user_id=c2c78da47ffb426888b5f0ec3fa2a98f, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:37.075655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea78d90-bfe2-4f6e-b177-d588d2fe83b1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:37.086665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1025/2062] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:37 2022] PUT /identity/v3/projects/7f9bdbda06c640bf99a449439cff0911/users/c2c78da47ffb426888b5f0ec3fa2a98f/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:37.098136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.098419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.098690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.100810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:37.102144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:37.125280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:37.129630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] MFA Rules not processed for user `c2c78da47ffb426888b5f0ec3fa2a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:37.130862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:37.153166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:37.169432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1038/2063] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:13:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:37.219602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1026/2064] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:37.225044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:37.226727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:37.234848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:37.236325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:37.305930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64255c-1f4f-4f45-83ef-1725a9da57c4 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:37.309739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:37.310354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.310633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.311044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.312769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f38c-7dcf-4a32-9660-db81c2374b80 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:37.319085 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:37.319777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:37.320167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:37.320492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:37.329340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:37.331005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:37.340035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1039/2065] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:13:37.398172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:37.400547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a0a8-a523-4848-aaa2-a06fc886a181 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:37.412787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1027/2066] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:13:40.091099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:40.171719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286e225-310f-45bb-b598-7ba2830a264a service swift] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:40.176691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:40.177356 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:40.177631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:40.177901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] PATH_INFO: `/v3/users/806f6ca72c9d46789bc0c5832cdab381` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:40.179126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806f6ca72c9d46789bc0c5832cdab381)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:40.181088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:40.238410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806f6ca72c9d46789bc0c5832cdab381'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:40.239197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806f6ca72c9d46789bc0c5832cdab381'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:40.264656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806f6ca72c9d46789bc0c5832cdab381'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:40.272038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:40.283187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806f6ca72c9d46789bc0c5832cdab381'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:40.291352 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806f6ca72c9d46789bc0c5832cdab381'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:40.302355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1040/2067] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:40 2022] DELETE /identity/v3/users/806f6ca72c9d46789bc0c5832cdab381 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:40.311780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:40.313029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:40.313223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:40.338836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:40.340974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:40.416439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1028/2068] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:40.429439 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:40.431443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:40.544515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6ac4-23c5-4ae3-b961-4d8af12e7e38 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:40.549303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:40.549809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:40.550089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:40.550365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:40.571817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:40.576884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:40.587114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1041/2069] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:40.914440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:40.915833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:40.929700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363b94-03c1-4c72-9488-df68ed41db8f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:40.936582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:40.937217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:40.937489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:40.937748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] PATH_INFO: `/v3/projects/ac8aa782a9374e5fb029f8dd1c2eabd8` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:40.938941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8aa782a9374e5fb029f8dd1c2eabd8)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:40.941031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:40.952417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:41.012146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8aa782a9374e5fb029f8dd1c2eabd8', 'request_id': 'req-6a8dc9c0-3344-4db6-9be0-519832f09f40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.020899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8aa782a9374e5fb029f8dd1c2eabd8', 'request_id': 'req-6a8dc9c0-3344-4db6-9be0-519832f09f40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.030509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8aa782a9374e5fb029f8dd1c2eabd8', 'request_id': 'req-6a8dc9c0-3344-4db6-9be0-519832f09f40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.048645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] The token cache is being invalidate because project ac8aa782a9374e5fb029f8dd1c2eabd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:41.048645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.048645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.050509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1029/2070] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:40 2022] DELETE /identity/v3/projects/ac8aa782a9374e5fb029f8dd1c2eabd8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:41.054479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:41.066384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b658-a4b2-454a-8e86-67f949e0cf92 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:41.130501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:41.131257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:41.131596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:41.131875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] PATH_INFO: `/v3/users/c2c78da47ffb426888b5f0ec3fa2a98f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:41.132995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c78da47ffb426888b5f0ec3fa2a98f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:41.134903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:41.190369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c78da47ffb426888b5f0ec3fa2a98f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.191375 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c78da47ffb426888b5f0ec3fa2a98f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.199197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c78da47ffb426888b5f0ec3fa2a98f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.215314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c78da47ffb426888b5f0ec3fa2a98f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.223487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-872baf9f-31c3-42a0-9136-b570cea45e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c78da47ffb426888b5f0ec3fa2a98f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:41.226377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:41.232132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1042/2071] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:13:41 2022] DELETE /identity/v3/users/c2c78da47ffb426888b5f0ec3fa2a98f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:41.904127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:41.908127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:41.929525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc9c0-3344-4db6-9be0-519832f09f40 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.014878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.015555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.015833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.016129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] PATH_INFO: `/v3/projects/7f9bdbda06c640bf99a449439cff0911` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.017329 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9bdbda06c640bf99a449439cff0911)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.019394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.078035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9bdbda06c640bf99a449439cff0911', 'request_id': 'req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:42.086222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9bdbda06c640bf99a449439cff0911', 'request_id': 'req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:42.097196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9bdbda06c640bf99a449439cff0911', 'request_id': 'req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:42.112701 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] The token cache is being invalidate because project 7f9bdbda06c640bf99a449439cff0911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:13:42.113067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:42.113642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5ffd71ca-d32a-4790-a034-e3ed54ac28fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:13:42.115165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1030/2072] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:13:41 2022] DELETE /identity/v3/projects/7f9bdbda06c640bf99a449439cff0911 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:13:42.121475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.122120 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.122460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.145570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:42.147747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:42.223306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1043/2073] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:42.229454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.229874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.230263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.253543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:42.254760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:42.263196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1031/2074] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:42.267848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.281020 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad239f-806f-4c20-87df-1a87d7b9d4dd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.286363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.286972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.287277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.287553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.288515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:13:42.288970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.290562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.304103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1044/2075] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:13:42.308261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.319251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcbc3d-a822-49c5-b285-3e2cd832bde3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.324310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.324947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.325222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.325492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.326784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.328777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.346335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:42.362881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1032/2076] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:13:42 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:13:42.367280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.378779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f42fc8-0749-464c-83d8-3b86ad7291c3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.445844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.446598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.446973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.447345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.448050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.450035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.476015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1045/2077] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:13:42 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:13:42.480652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.493036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b370496-fe9b-4048-a967-cd6771e8d39a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.499644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.500531 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.500907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.501275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.502017 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.503765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.520839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1033/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:13:42.521338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.535323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87f3d-1c53-4c39-8ab4-d794107bf18e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.540837 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.541554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.541902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.542244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.542982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.544806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a791c-8df6-43a5-8a28-5da9ab64882d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.562658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1046/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:13:42.565656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.578712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a0-d26e-4926-b62d-23ea1b5e7d61 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.584347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.584820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.585899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.586719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] PATH_INFO: `/v3/projects/767bb6f217fa4e818d2f6c74a2d02be0/users/826485381fc940c6b29fecc70cc8d529/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.610127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=767bb6f217fa4e818d2f6c74a2d02be0, user_id=826485381fc940c6b29fecc70cc8d529, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.612951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.631165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1034/2080] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:13:42 2022] PUT /identity/v3/projects/767bb6f217fa4e818d2f6c74a2d02be0/users/826485381fc940c6b29fecc70cc8d529/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:13:42.647754 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e641-c6b5-4e49-b3f2-273004a4d419 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.648031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e641-c6b5-4e49-b3f2-273004a4d419 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.648311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e641-c6b5-4e49-b3f2-273004a4d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.680779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f685e641-c6b5-4e49-b3f2-273004a4d419 None None] MFA Rules not processed for user `826485381fc940c6b29fecc70cc8d529`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:42.682403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f685e641-c6b5-4e49-b3f2-273004a4d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:42.760165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:42.772288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1047/2081] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:42.791193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:42.793707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:42.897833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24f59-ea66-4ac2-ba02-940cedf81a5c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:42.901923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:42.902553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:42.902830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:42.903134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:42.921755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:42.923456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:42.943043 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1035/2082] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:44.441419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b091-1361-428b-a2a4-71990e43914f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:44.441419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b091-1361-428b-a2a4-71990e43914f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:44.441419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b091-1361-428b-a2a4-71990e43914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:44.464408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0013b091-1361-428b-a2a4-71990e43914f None None] MFA Rules not processed for user `826485381fc940c6b29fecc70cc8d529`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:44.465778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0013b091-1361-428b-a2a4-71990e43914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:44.478483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1048/2083] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:45.011573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:45.013144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:45.106117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f509-c0ce-4671-9a88-fac468992a3d service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:45.111381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:45.112070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:45.112434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:45.112895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:45.114975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:45.128147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:45.129286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:45.141566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1036/2084] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:46.818536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b091-1361-428b-a2a4-71990e43914f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:46.827233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0013b091-1361-428b-a2a4-71990e43914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:46.926332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b091-1361-428b-a2a4-71990e43914f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:46.930044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:46.930656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:46.930946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:46.931233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:46.933065 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:46.944130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:46.946013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0bc35-a059-4fb8-bd42-1500852f5d4c service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:46.955489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1049/2085] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:50.523275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:50.525411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:50.584420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:13:50.606677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30751281-609d-4ebe-b73c-6af1909caecb service placement] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:50.612521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:50.613135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:50.613411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:50.613689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:50.615444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:50.628147 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:50.629715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb307-af87-4b5f-9f72-002de64d8ad3 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:50.641366 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1037/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:50.870215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aeea-dae0-4239-a4c2-7c3c21651d62 None None] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:50.870730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aeea-dae0-4239-a4c2-7c3c21651d62 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:50.870852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aeea-dae0-4239-a4c2-7c3c21651d62 None None] PATH_INFO: `/` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:50.872342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1050/2087] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:13:50.878990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620623a4-4d60-4efe-b0a2-81231b1bb725 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:50.879568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620623a4-4d60-4efe-b0a2-81231b1bb725 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:50.879846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620623a4-4d60-4efe-b0a2-81231b1bb725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:50.900319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-620623a4-4d60-4efe-b0a2-81231b1bb725 None None] MFA Rules not processed for user `1f1686221d7f4fdd942d96423204b366`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:50.901608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-620623a4-4d60-4efe-b0a2-81231b1bb725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:50.908152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1038/2088] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:13:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:50.921276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88aeea-dae0-4239-a4c2-7c3c21651d62 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:50.932174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88aeea-dae0-4239-a4c2-7c3c21651d62 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:50.936213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:50.936806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:50.937086 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:50.937365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:50.945057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:50.946482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a6d3-6074-44c2-8fbc-4b91e53346dd service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:50.955301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1051/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:51.037071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:51.037351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:51.037624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] PATH_INFO: `/` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:51.039244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1039/2090] 10.222.0.20 () {54 vars in 921 bytes} [Sun Oct 23 00:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:13:51.045883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:51.046408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:51.046673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:51.066796 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] MFA Rules not processed for user `81aba6d76ac940dcaa33247c65cc57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:51.068079 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:51.077507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1052/2091] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Oct 23 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:13:51.088230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:51.089886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:51.103109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678ee0-bb3f-4aed-b6d6-69ee3525d6ce None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:51.106644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:51.107829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:51.108106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:51.108378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:51.118790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:51.120298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:51.132010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1040/2092] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:13:51.202896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:51.215166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24e8fa-87d8-4e40-974c-ab2809f331be None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:51.221213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:51.221821 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:51.222101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:51.222373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:51.224169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:51.237550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:51.239310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9ccc7-9278-4777-b63b-b912f6d4ae8a service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:51.253557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1053/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:54.003187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:54.011663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d07dc-2b10-4ce7-9713-3be22f6413e8 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:54.015416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:54.016016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:54.016289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:54.016555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:54.018234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:54.027618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:54.029013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:54.036698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1041/2094] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:13:57.017691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:57.018260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:57.018369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:57.041379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:13:57.042615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:57.102787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1054/2095] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:13:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:13:57.115202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:57.116647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:57.195096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c770f3-3226-4f79-8849-9038106bdc2b service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:57.201937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:57.202559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:57.202833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:57.203122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:57.211951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:57.213535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:57.222398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1042/2096] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:13:58.121448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:13:58.123518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:58.145666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52911a-e4bf-444b-ac74-6896401e88ab None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:13:58.151273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:13:58.151961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:13:58.152240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:13:58.152511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:13:58.154293 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:13:58.216152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:13:58.217933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351b7c-63bb-49db-87fa-e00f0c6a66b0 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:13:58.227435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1055/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:13:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:01.543784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:01.558192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825abfbc-0b36-49a1-aa4b-ca7db2afc57a service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:01.564577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:01.565216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:01.565501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:01.565813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:01.567603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:01.635318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:01.637024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:01.646212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1043/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:08.222954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:11.641988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=85 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:14.750725 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47f86-9aaf-4fdb-9265-b1bbe347fe39 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:14.751309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47f86-9aaf-4fdb-9265-b1bbe347fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:14.751309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47f86-9aaf-4fdb-9265-b1bbe347fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:14.775783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a0e47f86-9aaf-4fdb-9265-b1bbe347fe39 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:14.777163 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a0e47f86-9aaf-4fdb-9265-b1bbe347fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:14.785186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1056/2099] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:14:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:14.798432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:14.810396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3f51-5a77-4c6d-b5fc-f3150baed735 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:14.815537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:14.816251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:14.816535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:14.816810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:14.824868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:14.826460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:14.834965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1044/2100] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:14:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:14:16.202500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0b1b-73e2-466e-a9fb-85e54d1f9bd0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:16.204366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0b1b-73e2-466e-a9fb-85e54d1f9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:16.204847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf0b1b-73e2-466e-a9fb-85e54d1f9bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:16.231654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-60bf0b1b-73e2-466e-a9fb-85e54d1f9bd0 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:16.233173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-60bf0b1b-73e2-466e-a9fb-85e54d1f9bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:16.243241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1057/2101] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:16.257700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:16.270540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108479-2cab-4b16-9a1b-f540883440fc service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:16.283172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:16.284042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:16.284311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:16.284578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:16.294192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:16.296089 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:16.307121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1045/2102] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:14:16.844492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28573a-5a9c-4754-9a49-f3dcc6de0a67 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:16.844768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28573a-5a9c-4754-9a49-f3dcc6de0a67 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:16.845613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28573a-5a9c-4754-9a49-f3dcc6de0a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:16.865731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-2a28573a-5a9c-4754-9a49-f3dcc6de0a67 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:16.867140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-2a28573a-5a9c-4754-9a49-f3dcc6de0a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:16.874513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1058/2103] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:16.887877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:16.898784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4312-d0bf-4b16-81d8-0752ba2277a4 service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:16.903943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:16.904538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:16.904818 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:16.905091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:16.913534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:16.915121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:16.924187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1046/2104] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:14:17.171091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9d956-c627-4b13-8206-f5f15f58bbf2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:17.172358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9d956-c627-4b13-8206-f5f15f58bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:17.172639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9d956-c627-4b13-8206-f5f15f58bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:17.203540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c6d9d956-c627-4b13-8206-f5f15f58bbf2 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:17.204744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c6d9d956-c627-4b13-8206-f5f15f58bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:17.212816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1059/2105] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:14:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:17.225539 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:17.236876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025a6d-ede5-462d-93f6-562a4cb33984 service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:17.243866 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:17.244544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:17.244936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:17.245274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:17.253816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:17.255494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:17.264051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1047/2106] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:14:17.660362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:17.660721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:17.661091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:17.680721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:17.682032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:17.690195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1060/2107] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:14:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:17.708367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:17.719597 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c97ab5-e583-4bbf-859a-2561317d9d5d service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:17.725264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:17.725870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:17.726149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:17.726426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:17.734928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:17.736541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01b9d8-b06b-400c-8813-2d78fca925a3 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:17.744714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1048/2108] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:14:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:14:19.824923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:19.888771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe155e-c389-4b5a-a203-f170ced47ca1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:19.893605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:19.894246 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:19.894523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:19.894798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] PATH_INFO: `/v3/users/826485381fc940c6b29fecc70cc8d529` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:19.896024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] RBAC: Authorizing `identity:delete_user(user_id=826485381fc940c6b29fecc70cc8d529)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:19.897937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:19.948634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826485381fc940c6b29fecc70cc8d529'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:19.949288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826485381fc940c6b29fecc70cc8d529'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:19.957919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826485381fc940c6b29fecc70cc8d529'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:19.978424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826485381fc940c6b29fecc70cc8d529'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:19.987054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826485381fc940c6b29fecc70cc8d529'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:19.993857 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1061/2109] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:19 2022] DELETE /identity/v3/users/826485381fc940c6b29fecc70cc8d529 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:19.998922 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:20.000063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:20.000302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:20.021560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:20.022850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:20.095937 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1049/2110] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:14:20.105863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:20.107509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:20.173387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:20.177879 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478355-e979-4bba-ad4e-3368467d036f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:20.182801 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:20.183488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:20.183918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:20.184544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:20.195011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:20.196462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:20.206717 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1062/2111] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:20.385449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:20.387190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:20.403207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95405f35-9354-4ea9-abfe-6c52e1b3c8d5 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:20.408945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:20.409735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:20.410080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:20.410561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] PATH_INFO: `/v3/projects/767bb6f217fa4e818d2f6c74a2d02be0` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:20.413036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=767bb6f217fa4e818d2f6c74a2d02be0)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:20.415816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:20.520093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767bb6f217fa4e818d2f6c74a2d02be0', 'request_id': 'req-c9ec5a77-3f66-4280-be30-d4252fb2d65d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:20.534632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767bb6f217fa4e818d2f6c74a2d02be0', 'request_id': 'req-c9ec5a77-3f66-4280-be30-d4252fb2d65d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:20.542099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767bb6f217fa4e818d2f6c74a2d02be0', 'request_id': 'req-c9ec5a77-3f66-4280-be30-d4252fb2d65d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:20.558359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] The token cache is being invalidate because project 767bb6f217fa4e818d2f6c74a2d02be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:20.558748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:20.559371 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:20.563282 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1050/2112] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:20 2022] DELETE /identity/v3/projects/767bb6f217fa4e818d2f6c74a2d02be0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:26.907970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:26.909407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:26.921099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4a14-7915-441c-8a54-95999e33cd5d service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:26.974799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:26.975384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:26.975716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:26.975928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:26.977640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:27.047575 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:27.049174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:27.060993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1063/2113] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:30.059027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.060443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:30.076444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5a77-3f66-4280-be30-d4252fb2d65d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.081586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.082208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.082482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.082754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] PATH_INFO: `/v3/users/a925c18e67894c06863e68b2793488d9` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.083895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a925c18e67894c06863e68b2793488d9)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.086071 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.099340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:30.141603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a925c18e67894c06863e68b2793488d9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.149274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a925c18e67894c06863e68b2793488d9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.157970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a925c18e67894c06863e68b2793488d9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.171687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a925c18e67894c06863e68b2793488d9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.172411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0de7eb4f-65c8-4aa9-874a-c4d4ac50d43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a925c18e67894c06863e68b2793488d9'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.178753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1051/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:30 2022] DELETE /identity/v3/users/a925c18e67894c06863e68b2793488d9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:30.355559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.366372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220335-732a-41d5-8e73-715873e7595d service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.431357 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.431986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.432266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.432537 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] PATH_INFO: `/v3/projects/ac30fa3ea0dd45c290b47780b39fbff3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.433638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac30fa3ea0dd45c290b47780b39fbff3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.435573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.487051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:30.494260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac30fa3ea0dd45c290b47780b39fbff3', 'request_id': 'req-8523640d-3b68-45e8-8fc9-525c92e1b3ab'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.501038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac30fa3ea0dd45c290b47780b39fbff3', 'request_id': 'req-8523640d-3b68-45e8-8fc9-525c92e1b3ab'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.507781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac30fa3ea0dd45c290b47780b39fbff3', 'request_id': 'req-8523640d-3b68-45e8-8fc9-525c92e1b3ab'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.525624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] The token cache is being invalidate because project ac30fa3ea0dd45c290b47780b39fbff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:30.526035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.526843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:30.529236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1064/2115] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:30 2022] DELETE /identity/v3/projects/ac30fa3ea0dd45c290b47780b39fbff3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:30.534149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ad18-32dd-45ed-b264-fc45046f2a45 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.534436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ad18-32dd-45ed-b264-fc45046f2a45 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.535030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ad18-32dd-45ed-b264-fc45046f2a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.560369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4241ad18-32dd-45ed-b264-fc45046f2a45 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:30.560369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4241ad18-32dd-45ed-b264-fc45046f2a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:30.564494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.565882 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:30.617460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1052/2116] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:30.623038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523640d-3b68-45e8-8fc9-525c92e1b3ab admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.625678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.625965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.626260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.627491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.628122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.628397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.628668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.630365 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:30.642432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.643881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.645521 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:30.646700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:30.653525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1065/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:14:30.657629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1053/2118] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:30.660023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.669848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af733-a526-4e23-bde6-083302304a4c service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.675471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.676057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.676332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.676630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.677256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:30.677551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.679435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.691528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1066/2119] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:30.695904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.705169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ab692-1716-464c-8589-9b71df838b11 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.709831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.710527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.710806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.711098 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.711739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.713629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.741885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1054/2120] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:30 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:30.745899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.761414 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a14ac-c2c1-4f53-8cee-ac28b2e7365b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.823492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.824103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.824384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.824658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.825288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.827266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.848920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1067/2121] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:30 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:30.852913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.865302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3cc4-e1ba-4033-a8fb-02183362471d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.868789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.869421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.869693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.869967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.870600 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.872208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.882209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1055/2122] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:30.886326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.897915 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac28ee9-8e1a-4fa6-b4c8-b25ea38789f8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.902783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.903554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.903937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.904260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.904987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.907253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec160f-7ca9-4942-8f38-1f448da2f880 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.921949 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1068/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:30.923670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:30.933918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876c6f-2ac7-4ec3-84ad-de439ab5dc2d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:30.938553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:30.939355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.939581 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.939847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] PATH_INFO: `/v3/projects/5e537f27763a4bf8a2529ed865596801/users/0b1c0f4fb249464b92f2e2a32a364e5c/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:30.954746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e537f27763a4bf8a2529ed865596801, user_id=0b1c0f4fb249464b92f2e2a32a364e5c, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:30.957410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:30.973725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1056/2124] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:30 2022] PUT /identity/v3/projects/5e537f27763a4bf8a2529ed865596801/users/0b1c0f4fb249464b92f2e2a32a364e5c/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:30.985243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:30.985527 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:30.985806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:31.013892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] MFA Rules not processed for user `0b1c0f4fb249464b92f2e2a32a364e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:31.015212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:31.042709 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:31.084908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1069/2125] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:31.095835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:31.097625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:31.129435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:31.175034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a239-0570-48dd-8903-a0ab184f7819 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:31.180653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:31.181263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:31.181541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:31.181814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:31.189759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:31.191382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb07aaf-add0-43df-96d5-459af5783aa4 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:31.200501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1057/2126] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:31.442877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:31.511587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857bf5-f093-4924-a630-663e0d321cb9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:31.517408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:31.518123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:31.518411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:31.518690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] PATH_INFO: `/v3/users/0b1c0f4fb249464b92f2e2a32a364e5c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:31.521643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1c0f4fb249464b92f2e2a32a364e5c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:31.523677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:31.579881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1c0f4fb249464b92f2e2a32a364e5c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:31.580563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1c0f4fb249464b92f2e2a32a364e5c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:31.590060 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1c0f4fb249464b92f2e2a32a364e5c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:31.606693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1c0f4fb249464b92f2e2a32a364e5c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:31.615687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1c0f4fb249464b92f2e2a32a364e5c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:31.622247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1070/2127] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:31 2022] DELETE /identity/v3/users/0b1c0f4fb249464b92f2e2a32a364e5c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:31.628091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:31.628695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:31.629072 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:31.651806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:31.653563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:31.722178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1058/2128] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:31.731760 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:31.734343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:31.795987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:31.803347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52689766-2e04-4a25-b253-ae72a25283d3 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:31.808731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:31.809756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:31.810108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:31.810452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:31.821692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:31.823242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1dd5e-87c4-464a-b9b2-e3aff8ab0d46 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:31.835000 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1071/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:32.158283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.160442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:32.176563 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b748ac-973a-46a1-be63-ea643be5b9bd None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.191143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.191970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.192255 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.192529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] PATH_INFO: `/v3/projects/5e537f27763a4bf8a2529ed865596801` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.193904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e537f27763a4bf8a2529ed865596801)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.195892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.291240 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e537f27763a4bf8a2529ed865596801', 'request_id': 'req-72a6f46d-7de6-408a-98bf-252aa34beccf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:32.303265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e537f27763a4bf8a2529ed865596801', 'request_id': 'req-72a6f46d-7de6-408a-98bf-252aa34beccf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:32.313182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e537f27763a4bf8a2529ed865596801', 'request_id': 'req-72a6f46d-7de6-408a-98bf-252aa34beccf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:32.329177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] The token cache is being invalidate because project 5e537f27763a4bf8a2529ed865596801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:32.329575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:32.330345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-72a6f46d-7de6-408a-98bf-252aa34beccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:32.337034 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1059/2130] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:32 2022] DELETE /identity/v3/projects/5e537f27763a4bf8a2529ed865596801 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:32.338689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.338975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.339287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.366204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:32.367952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:32.438430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1072/2131] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:32.447805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.448244 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.448626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.473703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:32.475134 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:32.485015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1060/2132] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:32.489319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.499883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a125-76e3-4f9b-98d6-4f2b6d94254a None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.505397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.506024 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.506301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.506571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.507262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:32.507568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.509189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.534699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1073/2133] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:32.537151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.560193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbf7e8-0935-4616-9bbf-00b8f93c566c None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.571412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.572045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.572326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.572601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.573412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.575781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.619763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1061/2134] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:32 2022] POST /identity/v3/projects => generated 403 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:32.621271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.636647 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32734dbd-f1a4-496a-a286-3882883f4e66 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.727468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.728213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.728572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.729891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.730639 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.734110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.768722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1074/2135] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:32 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:32.771051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.786107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468a1e-f5bb-4c0e-b788-cf289ff18380 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.794966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.796139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.796770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.797369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.798205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.799983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.802249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:32.818960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1062/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:32.820191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.833067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970faf88-2a64-4079-984d-a50f415f02e0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.838869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.839656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.840037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.840434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.841181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.842848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b94a2-d479-4fd6-923a-3f6004b1eb59 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.854428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1075/2137] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:32.858579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:32.869500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8fc1-3843-448f-a8fe-0f1c41787f23 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:32.874617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:32.875712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.876002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.876276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] PATH_INFO: `/v3/projects/8666f1cf90144313bf7c1f7f9b48584d/users/5888deb4a8b3453db91cba1528890800/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.896310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8666f1cf90144313bf7c1f7f9b48584d, user_id=5888deb4a8b3453db91cba1528890800, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:32.898995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:32.913653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1063/2138] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:32 2022] PUT /identity/v3/projects/8666f1cf90144313bf7c1f7f9b48584d/users/5888deb4a8b3453db91cba1528890800/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:32.925403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:32.925596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:32.926028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:32.963840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] MFA Rules not processed for user `5888deb4a8b3453db91cba1528890800`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:32.965049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:33.013272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:33.036736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1076/2139] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:33.041216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.105678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b90b-8379-495e-b99f-6a6b1e1b86b9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.110862 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.111508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.111787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.112058 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.112684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.114584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.142543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1064/2140] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:33 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:33.146644 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.158437 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617135f1-657a-42d7-8e7b-c719eb77e147 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.221555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.222171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.222453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.222727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.223395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.225321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.250731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1077/2141] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:33 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:33.252101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.263615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef385eb-b0d0-47e2-b854-375969172988 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.272031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.272770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.273146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.273512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.274258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.276006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.291542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1065/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:33.295990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.309740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc521a9-9219-47a7-be15-e27945fded23 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.314323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.315026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.315348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.315626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] PATH_INFO: `/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6/users/59d6765339114d18890385485c7e2490/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.333420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d544e4bb1024a6aadf330773d9fb0e6, user_id=59d6765339114d18890385485c7e2490, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.336299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.354041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1078/2143] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:33 2022] PUT /identity/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6/users/59d6765339114d18890385485c7e2490/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:33.358715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.370910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191e97-4a0f-465e-bdb8-f3a6f2b27a99 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.476964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.477670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.478059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.478401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.479219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.483776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f661645-fe65-48a0-9898-0b44ee5f1922 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.503189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1066/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:33.506067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.539044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59aaa5-951c-431d-b0fe-fee4892dbe08 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.544241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.545058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.545444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.546260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] PATH_INFO: `/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6/users/59d6765339114d18890385485c7e2490/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.551751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d544e4bb1024a6aadf330773d9fb0e6, user_id=59d6765339114d18890385485c7e2490, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.554608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.575534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1079/2145] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:33 2022] PUT /identity/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6/users/59d6765339114d18890385485c7e2490/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:33.586868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.587258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.587616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.626780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] MFA Rules not processed for user `59d6765339114d18890385485c7e2490`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:33.628221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:33.669961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:33.733601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1067/2146] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:33.744259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:33.750508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:33.814104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f61899-028e-4a8c-83f2-04a97c5f6f0b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:33.817985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:33.818671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:33.819023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:33.819462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:33.831088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:33.832610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:33.843105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1080/2147] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:33 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:34.006338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.086724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943fe7-acaa-40c6-8fdc-bb339577ad6b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.091227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.091880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.092156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.092428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] PATH_INFO: `/v3/users/5888deb4a8b3453db91cba1528890800` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.094456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5888deb4a8b3453db91cba1528890800)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.096717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.143616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.145031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.158264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5888deb4a8b3453db91cba1528890800'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.164242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed627b-ecb5-41d1-8d81-d78bee4e1b5a service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.165757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5888deb4a8b3453db91cba1528890800'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.169330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.170183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.170468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.171009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] PATH_INFO: `/v3/users/db8a7662772f4ac69378d3f33e5e6098` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.172218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8a7662772f4ac69378d3f33e5e6098)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.173825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5888deb4a8b3453db91cba1528890800'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.174132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.187229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5888deb4a8b3453db91cba1528890800'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.188139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d71911f5-ea93-464a-a1a9-1237c9d8e396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5888deb4a8b3453db91cba1528890800'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.194791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1068/2148] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:34 2022] DELETE /identity/v3/users/5888deb4a8b3453db91cba1528890800 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:34.199305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.199622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.199869 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.214844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:34.221704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:34.222987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.226620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8a7662772f4ac69378d3f33e5e6098'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.230149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8a7662772f4ac69378d3f33e5e6098'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.237884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8a7662772f4ac69378d3f33e5e6098'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.250210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8a7662772f4ac69378d3f33e5e6098'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.256975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8a7662772f4ac69378d3f33e5e6098'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.262816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1081/2149] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:34 2022] DELETE /identity/v3/users/db8a7662772f4ac69378d3f33e5e6098 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:34.265959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:34.286732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1069/2150] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:34.297747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.299544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.360252 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937286c2-2c86-4e2b-b128-8a73b5feb7f5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.363919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.364545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.364851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.365129 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.428131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.429761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e432a-c2b6-4901-a3b2-17d5927687e8 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.440058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1082/2151] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:34.455052 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.456712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.475964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9e41-70a9-49db-957c-15b044a50899 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.481065 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.481991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.482194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.482484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] PATH_INFO: `/v3/projects/da54fddf264949ca958df153c033438a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.483873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da54fddf264949ca958df153c033438a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.486084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.547558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da54fddf264949ca958df153c033438a', 'request_id': 'req-c0c109bf-33e0-4946-803b-1b3214c9a7f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.556095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da54fddf264949ca958df153c033438a', 'request_id': 'req-c0c109bf-33e0-4946-803b-1b3214c9a7f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.563313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da54fddf264949ca958df153c033438a', 'request_id': 'req-c0c109bf-33e0-4946-803b-1b3214c9a7f1'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.575652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] The token cache is being invalidate because project da54fddf264949ca958df153c033438a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:34.575944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.576691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c0c109bf-33e0-4946-803b-1b3214c9a7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.578797 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1070/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:34 2022] DELETE /identity/v3/projects/da54fddf264949ca958df153c033438a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:34.583879 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.584354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.584555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.606835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:34.608370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.669220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1083/2153] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:14:34.677144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.677431 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.677710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.698022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:34.699273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.708010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1071/2154] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:34.712564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.718019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:34.725542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.727218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.727625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ceca-b27f-4f1b-8a40-db9c237f4690 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.734178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.735418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.735892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.736380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.737222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:34.737755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.739454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.740318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436c44-426d-4390-a22a-caea8e628792 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.745830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.746793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.746793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.746997 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] PATH_INFO: `/v3/projects/8666f1cf90144313bf7c1f7f9b48584d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.748139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8666f1cf90144313bf7c1f7f9b48584d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.750737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.754671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1084/2155] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:34.758878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.769853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f6806-9ffa-4208-9306-88ba44056208 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.774990 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.775742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.776026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.776297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.776920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.779304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.806192 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8666f1cf90144313bf7c1f7f9b48584d', 'request_id': 'req-91235666-fdc8-4efa-bd7b-7a8561a66cf6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.807372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1085/2156] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:34 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:34.811346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.817234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8666f1cf90144313bf7c1f7f9b48584d', 'request_id': 'req-91235666-fdc8-4efa-bd7b-7a8561a66cf6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.823788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8666f1cf90144313bf7c1f7f9b48584d', 'request_id': 'req-91235666-fdc8-4efa-bd7b-7a8561a66cf6'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.835626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] The token cache is being invalidate because project 8666f1cf90144313bf7c1f7f9b48584d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:34.835916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.836574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.838132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1072/2157] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:34 2022] DELETE /identity/v3/projects/8666f1cf90144313bf7c1f7f9b48584d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:34.841908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.843225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.876236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ade37-efd4-404e-9eef-d0da50e08e30 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.881787 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.882394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.882668 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.882939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.883608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.885590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.892684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:34.910050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1086/2158] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:34 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:34.913775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91235666-fdc8-4efa-bd7b-7a8561a66cf6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.913945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.915554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:34.918807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.919497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.919892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.920174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] PATH_INFO: `/v3/users/59d6765339114d18890385485c7e2490` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.921575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d6765339114d18890385485c7e2490)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.924285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.928103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d287b3-4199-465e-94c6-1c50e9f2f88f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.932722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.933290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.933566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.933835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.934465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.936057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.946564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1087/2159] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:34.951460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.962101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445459f-0ca3-44da-9f53-37cc44bb583c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:34.966776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:34.967403 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:34.967689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:34.967963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:34.968619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:34.970179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:34.974844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d6765339114d18890385485c7e2490'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.981541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1088/2160] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:34.982460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d6765339114d18890385485c7e2490'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.986671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:34.992393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d6765339114d18890385485c7e2490'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:34.997128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863bc1d-2add-4150-b405-487e3000273d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:35.002734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:35.003430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.003707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.003977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] PATH_INFO: `/v3/projects/26b09407965f4b52bf138aaf44d67498/users/e67a90462a074bbc93fc92faca85e23c/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.015254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d6765339114d18890385485c7e2490'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.016194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-c5928c39-daa6-42d9-8acd-f2ad510379c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d6765339114d18890385485c7e2490'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.023724 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b09407965f4b52bf138aaf44d67498, user_id=e67a90462a074bbc93fc92faca85e23c, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:35.026020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1073/2161] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:34 2022] DELETE /identity/v3/users/59d6765339114d18890385485c7e2490 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:35.027450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:35.044250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1089/2162] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:34 2022] PUT /identity/v3/projects/26b09407965f4b52bf138aaf44d67498/users/e67a90462a074bbc93fc92faca85e23c/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:35.057513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.058168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.058618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.097820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] MFA Rules not processed for user `e67a90462a074bbc93fc92faca85e23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:35.099661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:35.172378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1074/2163] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:35.183462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:35.185341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:35.263603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f45c-f35a-4e3a-a30f-3d1051e43082 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:35.269236 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:35.269853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.270130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.270400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.276672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:35.280023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:35.283010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40506d-db92-4abb-8a29-a979751d0d47 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:35.294462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1090/2164] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:35.578874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:35.582485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:35.661857 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:35.669335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d599bc-e54c-4d59-9f2f-2e378b482fa8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:35.679132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:35.680002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.680283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.680646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] PATH_INFO: `/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.682360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d544e4bb1024a6aadf330773d9fb0e6)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:35.684924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:35.733534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d544e4bb1024a6aadf330773d9fb0e6', 'request_id': 'req-7055b820-c72d-4817-a3b8-f0169fb6b038'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.741577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d544e4bb1024a6aadf330773d9fb0e6', 'request_id': 'req-7055b820-c72d-4817-a3b8-f0169fb6b038'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.747495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d544e4bb1024a6aadf330773d9fb0e6', 'request_id': 'req-7055b820-c72d-4817-a3b8-f0169fb6b038'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.759211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] The token cache is being invalidate because project 9d544e4bb1024a6aadf330773d9fb0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:35.759501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.760126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7055b820-c72d-4817-a3b8-f0169fb6b038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:35.761601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1075/2165] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:35 2022] DELETE /identity/v3/projects/9d544e4bb1024a6aadf330773d9fb0e6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:35.766613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.767067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.767276 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.787298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:35.788420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:35.847764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1091/2166] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:35.856788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.857080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.857357 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.879383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:35.880568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:35.889953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1076/2167] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:35.896288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:35.912169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151d439-20ec-4e56-bcfe-a6d07e68eb86 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:35.916844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:35.917448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.917726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.917998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.918637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:35.918936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:35.920830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:35.933095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1092/2168] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:14:35.938019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:35.947217 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a6789-4b8a-4fe1-8e4d-febe0a9352da None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:35.951798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:35.952384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:35.952656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:35.952923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:35.953553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:35.955516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:35.981993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1077/2169] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:35 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:35.986820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:35.996551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e216d1-d213-4fa3-9f47-37ae3b56327d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.054267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.054871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.055192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.055498 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.056178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.058087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.080538 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1093/2170] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:35 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:36.084438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.095223 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcba86-bc72-4592-9b1d-ba5b43c00522 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.099856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.100464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.100732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.101006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.101639 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.103269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.114149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1078/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:36.117856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.127777 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166f325-d509-4cb8-a151-76db8990b781 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.132372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.132958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.133238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.133511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.134140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.135749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b76d4-6fcd-40d0-b483-1b3572fcdd3e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.146289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1094/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:36.150475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.160874 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db045a8-d8d6-47de-ae24-b1c95277e002 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.165428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.166067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.166368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.166621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] PATH_INFO: `/v3/projects/5beb90284a1d4c9785712f2c64d8cc12/users/0947c709a252425496f2f28dc8c416b2/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.182189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5beb90284a1d4c9785712f2c64d8cc12, user_id=0947c709a252425496f2f28dc8c416b2, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.184850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.197940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1079/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:36 2022] PUT /identity/v3/projects/5beb90284a1d4c9785712f2c64d8cc12/users/0947c709a252425496f2f28dc8c416b2/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:36.208194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.208477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.208750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.237115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] MFA Rules not processed for user `0947c709a252425496f2f28dc8c416b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:36.238264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:36.286161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:36.303854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1095/2174] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:36.308491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.370364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32731f-ab28-44a7-b757-36f8f690a2ae admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.375249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.375841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.376114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.376380 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.376993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.378856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.405009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1080/2175] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:36 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:36.409672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.420095 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8818-fd8d-4c41-8269-93fbaa200e92 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.476202 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.476793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.477069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.477338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.477965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.479888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.499715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1096/2176] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:36 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:36.503727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.514048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9ecbc-1e57-4146-bee5-e1b5eca279fc admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.519406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.520018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.520296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.520568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.521197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.522867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.524246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:36.536245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1081/2177] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:36.539982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.550130 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af876e6-9779-4aa3-8911-eab59a7d90af admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.554653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.555327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.555604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.555874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] PATH_INFO: `/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86/users/52dc10927235470f9947a40836917349/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.570106 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107c446b3b7e4bc69861da5f5f1b4b86, user_id=52dc10927235470f9947a40836917349, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.572768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.585479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1097/2178] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:36 2022] PUT /identity/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86/users/52dc10927235470f9947a40836917349/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:36.589387 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.600409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89306-d0aa-4712-a1a5-18e0acd539ef admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.655455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.656630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.656910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.657181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.657810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.659413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b556ad-1c19-421d-b608-d550cd720cff admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.668912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1082/2179] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:36.673211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.683566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5396-064d-4d2b-be96-c85d258dd3f1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.688686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.689329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.689609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.689887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] PATH_INFO: `/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86/users/52dc10927235470f9947a40836917349/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.691824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107c446b3b7e4bc69861da5f5f1b4b86, user_id=52dc10927235470f9947a40836917349, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.694465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.705102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1098/2180] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:36 2022] PUT /identity/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86/users/52dc10927235470f9947a40836917349/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:36.716160 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.716829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.716829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.745019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] MFA Rules not processed for user `52dc10927235470f9947a40836917349`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:36.746403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:36.818593 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1083/2181] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:36.831993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:36.836972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:36.896687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e51b-30d7-4df8-8caa-464be7ec20d0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:36.901071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:36.901673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:36.901947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:36.902215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:36.916593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:36.918035 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:36.928719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1099/2182] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:37.011635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:37.013068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:37.025496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46e00-7e55-491e-9be4-36306a6ab7a8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:37.029146 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:37.029753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:37.030032 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:37.030304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:37.088918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:37.090296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d34692-c22c-4cf9-ad5c-4af72b79643b service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:37.099443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1084/2183] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:38.022567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.022567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.071321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:38.088936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4de98-5f56-4672-b6ff-45d12cfebdca service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:38.093407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:38.094605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.094887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.095196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] PATH_INFO: `/v3/users/e67a90462a074bbc93fc92faca85e23c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.096309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67a90462a074bbc93fc92faca85e23c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:38.098244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:38.143678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67a90462a074bbc93fc92faca85e23c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.144321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67a90462a074bbc93fc92faca85e23c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.151431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67a90462a074bbc93fc92faca85e23c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.164566 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67a90462a074bbc93fc92faca85e23c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.172204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67a90462a074bbc93fc92faca85e23c'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.178044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1100/2184] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:38 2022] DELETE /identity/v3/users/e67a90462a074bbc93fc92faca85e23c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:38.182492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.182956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.183060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.202230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:38.204232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.214334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:38.266579 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1085/2185] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:38.276006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.277551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.342219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1a71-f1c0-4ce8-8264-a7684a621160 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:38.346048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:38.346656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.346933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.347241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.356490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:38.357904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303722b-db17-4f81-a2c3-035950f67671 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:38.368262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1101/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:38.639249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.641203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.652841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4c000-7eee-4d8f-812f-42e89cd054d6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:38.658298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:38.658805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.659440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.659440 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] PATH_INFO: `/v3/projects/26b09407965f4b52bf138aaf44d67498` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.660515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b09407965f4b52bf138aaf44d67498)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:38.662416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:38.719155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b09407965f4b52bf138aaf44d67498', 'request_id': 'req-8ce218eb-e8ee-4eb9-ab22-1e684822e673'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.727061 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b09407965f4b52bf138aaf44d67498', 'request_id': 'req-8ce218eb-e8ee-4eb9-ab22-1e684822e673'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.732778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b09407965f4b52bf138aaf44d67498', 'request_id': 'req-8ce218eb-e8ee-4eb9-ab22-1e684822e673'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.744547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] The token cache is being invalidate because project 26b09407965f4b52bf138aaf44d67498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:38.744778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.745423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-8ce218eb-e8ee-4eb9-ab22-1e684822e673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:38.746910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1086/2187] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:38 2022] DELETE /identity/v3/projects/26b09407965f4b52bf138aaf44d67498 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:38.752786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.753116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.753420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.774226 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:38.775952 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.835841 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1102/2188] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:38.843703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.843984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.844258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.865159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:38.866346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:38.874062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1087/2189] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:38.878843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.888449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da247-438a-4dad-9628-bb4b11429acc None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:38.893059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:38.893652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.893970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.894223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.894859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:38.895189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:38.896789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:38.899193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:38.909445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1103/2190] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:38.913537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.923459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a32f-399f-4737-a133-6ab7e46e8c36 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:38.929064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:38.929654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:38.929929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:38.930198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:38.930836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:38.932780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:38.959637 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1088/2191] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:38 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:38.963652 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:38.974192 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673824-813b-4651-adc5-cdf09da295f2 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.030374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.031561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.031698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.032015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.032740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.034661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.056360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1104/2192] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:38 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:39.060550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.070746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfad99-624a-4447-9f74-8fb63bef584c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.075341 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.075935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.076210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.076479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.077115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.078679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.088921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1089/2193] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:39.092734 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.102864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99140d0-67d1-48f4-9bb5-9bd283f60d8e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.107393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.107972 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.108247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.108516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.109712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.111303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57368e7b-22bf-4a42-ab21-384a03d9f956 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.121859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1105/2194] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:39.125935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.136323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c857-08e3-4747-9d3a-2235c94af056 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.140921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.141560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.141837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.142110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] PATH_INFO: `/v3/projects/d306b9abad5d48c98220cbc4fd288b88/users/9baabf57191b4b76b66d55221f25fc76/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.156785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d306b9abad5d48c98220cbc4fd288b88, user_id=9baabf57191b4b76b66d55221f25fc76, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.159764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.173697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1090/2195] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:39 2022] PUT /identity/v3/projects/d306b9abad5d48c98220cbc4fd288b88/users/9baabf57191b4b76b66d55221f25fc76/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:39.183916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.184291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.184591 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.212487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] MFA Rules not processed for user `9baabf57191b4b76b66d55221f25fc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:39.213673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:39.276731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1106/2196] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:39.282709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.323608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:39.348732 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141158dc-9814-478b-8906-9be2b6dccb44 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.353372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.353975 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.354251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.354519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.355168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.357057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.382584 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1091/2197] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:39 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:39.386750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.397793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153d72-03aa-4fca-a66b-fe9b12840bda None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.452009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.452608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.453386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.453653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.454267 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.456183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.465873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:39.478445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1107/2198] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:39 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:39.482582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.492815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9fa52-fb01-417d-9531-ec43b7a12c4d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.497457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.498047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.498322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.498590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.499257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.501116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.511896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1092/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:39.516500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.526911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5689ba-5eb5-489d-98a8-d81282ba78a7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.532392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.533100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.533331 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.533632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] PATH_INFO: `/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a/users/8117186bc6eb4d67aac337f195f0ef7e/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.548662 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3acd4c0d174f8b9c61b37d2a74f59a, user_id=8117186bc6eb4d67aac337f195f0ef7e, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.551332 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.563917 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1108/2200] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:39 2022] PUT /identity/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a/users/8117186bc6eb4d67aac337f195f0ef7e/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:39.567870 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.578347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792780-97d4-416f-961e-4e1472deff11 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.633199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.633794 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.634069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.634340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.634968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.636572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646d22-9907-4fae-8218-3b9552e099bc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.646540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1093/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:39.650632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.661395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c975e-da2e-49db-94c5-45ce8f4df838 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.665920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.666554 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.666828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.667128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] PATH_INFO: `/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a/users/8117186bc6eb4d67aac337f195f0ef7e/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.669019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3acd4c0d174f8b9c61b37d2a74f59a, user_id=8117186bc6eb4d67aac337f195f0ef7e, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.672183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.681998 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1109/2202] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:39 2022] PUT /identity/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a/users/8117186bc6eb4d67aac337f195f0ef7e/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:39.693798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.694084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.694360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.722177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] MFA Rules not processed for user `8117186bc6eb4d67aac337f195f0ef7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:39.723423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:39.796398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1094/2203] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:39.808104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.809823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:39.857641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.859280 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:39.873068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9a835-7690-4321-885c-b299325d7e5a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.877291 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.877898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.878175 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.878443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.887921 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.889572 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.895594 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:39.900856 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1110/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:39.930059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44962f35-ff10-44d4-b697-0a1f16212aba None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.934653 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.935421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.935698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.935979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] PATH_INFO: `/v3/users/0947c709a252425496f2f28dc8c416b2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.937686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0947c709a252425496f2f28dc8c416b2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:39.939980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:39.977660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:39.987645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b1aa-6e32-4fb6-8f3c-9275aa21955e service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:39.988904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0947c709a252425496f2f28dc8c416b2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:39.991405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:39.991997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:39.992275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:39.992548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:39.996236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0947c709a252425496f2f28dc8c416b2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.004814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0947c709a252425496f2f28dc8c416b2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.018506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0947c709a252425496f2f28dc8c416b2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.019225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5957abd2-d2cc-4329-942e-171a139161f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0947c709a252425496f2f28dc8c416b2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.025073 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1095/2205] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:39 2022] DELETE /identity/v3/users/0947c709a252425496f2f28dc8c416b2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:40.030332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:40.030614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:40.030940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:40.050719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:40.051002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:40.051885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:40.052454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:40.061604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1111/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:14:40.111544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1096/2207] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:40.121620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:40.123147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:40.190637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8d50-e849-4304-982e-52b6cd9e5bff service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:40.202118 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:40.245069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:40.245679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:40.245958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:40.246230 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:40.255370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:40.256782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:40.266657 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1112/2208] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:40.529658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:40.531681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:40.544358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08212-77c8-4371-910e-df9ce2c1428d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:40.550311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:40.550953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:40.551267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:40.551546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] PATH_INFO: `/v3/projects/5beb90284a1d4c9785712f2c64d8cc12` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:40.552710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5beb90284a1d4c9785712f2c64d8cc12)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:40.554660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:40.599476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:40.602502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5beb90284a1d4c9785712f2c64d8cc12', 'request_id': 'req-d37566fe-0559-49aa-8881-eed811bf6c65'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.611006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5beb90284a1d4c9785712f2c64d8cc12', 'request_id': 'req-d37566fe-0559-49aa-8881-eed811bf6c65'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.616605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5beb90284a1d4c9785712f2c64d8cc12', 'request_id': 'req-d37566fe-0559-49aa-8881-eed811bf6c65'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.627589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] The token cache is being invalidate because project 5beb90284a1d4c9785712f2c64d8cc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:40.627875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.628492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.629949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1097/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:40 2022] DELETE /identity/v3/projects/5beb90284a1d4c9785712f2c64d8cc12 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:40.634075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:40.643536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d325c0-fdb7-4ba6-8bd5-580351ce3f1d service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:40.698128 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:40.698756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:40.699033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:40.699338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] PATH_INFO: `/v3/users/52dc10927235470f9947a40836917349` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:40.700436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dc10927235470f9947a40836917349)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:40.702341 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:40.747684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dc10927235470f9947a40836917349'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.748320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dc10927235470f9947a40836917349'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.755463 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dc10927235470f9947a40836917349'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.767379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dc10927235470f9947a40836917349'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.774620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9dc8c2a4-8232-4dc5-8bc1-35a3f0f47cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dc10927235470f9947a40836917349'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:40.781960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1113/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:40 2022] DELETE /identity/v3/users/52dc10927235470f9947a40836917349 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:41.057875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.059457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:41.074298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37566fe-0559-49aa-8881-eed811bf6c65 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.132459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.133023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.133300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.133573 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] PATH_INFO: `/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.134677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107c446b3b7e4bc69861da5f5f1b4b86)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.136690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.182851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107c446b3b7e4bc69861da5f5f1b4b86', 'request_id': 'req-e123c604-2a1b-47df-b357-57c806091b91'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:41.190872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107c446b3b7e4bc69861da5f5f1b4b86', 'request_id': 'req-e123c604-2a1b-47df-b357-57c806091b91'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:41.196499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107c446b3b7e4bc69861da5f5f1b4b86', 'request_id': 'req-e123c604-2a1b-47df-b357-57c806091b91'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:41.208714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] The token cache is being invalidate because project 107c446b3b7e4bc69861da5f5f1b4b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:41.209005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:41.209661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e123c604-2a1b-47df-b357-57c806091b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:41.211208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1098/2211] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:41 2022] DELETE /identity/v3/projects/107c446b3b7e4bc69861da5f5f1b4b86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:41.216099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.216580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.216776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.240604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:41.241827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:41.274529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:41.308588 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1114/2212] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:41.317676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.317951 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.318221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.340102 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:41.341246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:41.349074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1099/2213] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:14:41.353377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.363234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b81c3-07f3-47bd-8d71-cd0383ce2355 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.367923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.368519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.368798 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.369063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.369714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:41.370016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.371643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.383878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1115/2214] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:41.388144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.399703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e47b3-e2e4-4496-a9a2-e463a1708f92 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.405622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.406251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.406665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.406940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.407615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.410047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.442155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1100/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:41.446445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.457283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e760eb-a961-4c3b-9428-cf804c72d01f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.535997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.535997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.535997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.535997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.536362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.536362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.556678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1116/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:41.557472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.568444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12145-d9e7-4869-baa0-c5e52e71d461 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.574265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.574889 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.575272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.575549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.576190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.580369 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.591125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1101/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:41.594339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.605746 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b851-7cf6-4aba-b442-d53bdf9e79fb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.610723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.611479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.611803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.612323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.613139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.614778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc28a6-d62d-4e8f-af63-35aca1ec7068 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.626052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1117/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:41.630737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.641159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a7ad-4839-47eb-8e74-8fbc6763cd36 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.645631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.646274 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.646550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.646825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] PATH_INFO: `/v3/projects/70b53d4ab18b44c3a95bed7b9ddf2a41/users/2d74ba154b5f4881be5b934ec85a4977/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.661724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b53d4ab18b44c3a95bed7b9ddf2a41, user_id=2d74ba154b5f4881be5b934ec85a4977, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.664432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.673094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:41.677861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1102/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:41 2022] PUT /identity/v3/projects/70b53d4ab18b44c3a95bed7b9ddf2a41/users/2d74ba154b5f4881be5b934ec85a4977/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:41.688235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.688595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.688939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.717800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] MFA Rules not processed for user `2d74ba154b5f4881be5b934ec85a4977`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:41.719645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:41.784025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1118/2220] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:41.788667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.852628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4859c-2aa8-46bd-bc26-7c203cd3053c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.857262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.857849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.858123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.858393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.859169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.861050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.887055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1103/2221] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:41.891699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.902206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4556-67ab-4ab0-b820-c1a869785fef None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:41.930843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:41.959093 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:41.959702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:41.959982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:41.960255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:41.960887 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:41.962778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:41.983144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1119/2222] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:41 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:41.987216 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:41.997385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b0888-38f3-43c4-8f1e-3490f1ea2e03 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:42.003193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:42.003993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.004365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.004712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.005403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:42.007067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:42.018552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1104/2223] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:42.022696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:42.032836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2730-eb4f-4b70-9780-3a9e89559663 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:42.037490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:42.038150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.038430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.038723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] PATH_INFO: `/v3/projects/51995c583d344041b04ff04836bf7253/users/984e2900d0724057b1537fc632b74ab7/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.053665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51995c583d344041b04ff04836bf7253, user_id=984e2900d0724057b1537fc632b74ab7, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:42.056368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:42.069493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1120/2224] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:42 2022] PUT /identity/v3/projects/51995c583d344041b04ff04836bf7253/users/984e2900d0724057b1537fc632b74ab7/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:42.073370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:42.083896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a90b13-32de-4e21-8d1a-b008889400cc admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:42.140790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:42.141344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.141624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.141931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.142516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:42.144150 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b7b8-5fbd-4d36-af1d-4c5225148a30 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:42.153613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1105/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:42.157692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:42.167916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca11fe3-0f6a-4152-83a3-abb3a140416b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:42.172751 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:42.173386 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.173665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.173940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] PATH_INFO: `/v3/projects/51995c583d344041b04ff04836bf7253/users/984e2900d0724057b1537fc632b74ab7/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.175866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51995c583d344041b04ff04836bf7253, user_id=984e2900d0724057b1537fc632b74ab7, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:42.178488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:42.188937 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1121/2226] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:42 2022] PUT /identity/v3/projects/51995c583d344041b04ff04836bf7253/users/984e2900d0724057b1537fc632b74ab7/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:42.199888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.200178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.200454 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.228726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] MFA Rules not processed for user `984e2900d0724057b1537fc632b74ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:42.229934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:42.289226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:42.300045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1106/2227] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:42.310865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:42.313228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:42.370044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3376c-1cdd-4769-87eb-6b87d52c2220 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:42.373677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:42.374277 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:42.375147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:42.375431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:42.430338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:42.431715 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:42.440970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1122/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:45.033246 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:45.042795 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1b2a-50aa-4281-8438-641393d37d10 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:45.046640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:45.047261 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:45.047537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:45.047813 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:45.056662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:45.058063 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5656-5731-4b4f-adf2-0052a8076317 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:45.068016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1107/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:46.906533 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:46.907987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:46.950047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:46.975138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce391-4757-4967-b2a8-ebfd72bc3f12 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:46.979903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:46.980529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:46.980805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:46.981076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] PATH_INFO: `/v3/users/9baabf57191b4b76b66d55221f25fc76` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:46.982186 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baabf57191b4b76b66d55221f25fc76)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:46.984169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:47.031716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baabf57191b4b76b66d55221f25fc76'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.032301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baabf57191b4b76b66d55221f25fc76'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.038891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baabf57191b4b76b66d55221f25fc76'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.051029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baabf57191b4b76b66d55221f25fc76'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.057820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baabf57191b4b76b66d55221f25fc76'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.063651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1123/2230] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:46 2022] DELETE /identity/v3/users/9baabf57191b4b76b66d55221f25fc76 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:47.068173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:47.068679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:47.068787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:47.088107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:47.089288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:47.149249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1108/2231] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:47.159646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:47.161107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:47.218595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5f6f-f238-45fd-a703-e8a07fd21429 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:47.222306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:47.222922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:47.223245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:47.223552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:47.232549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:47.233958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:47.243358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1124/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:47.510412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:47.511959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:47.525789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c499c-6c73-4617-aa58-4d83a8af54a7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:47.533909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:47.534559 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:47.534833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:47.535271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] PATH_INFO: `/v3/projects/d306b9abad5d48c98220cbc4fd288b88` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:47.536438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d306b9abad5d48c98220cbc4fd288b88)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:47.538301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:47.585915 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd306b9abad5d48c98220cbc4fd288b88', 'request_id': 'req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.594636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd306b9abad5d48c98220cbc4fd288b88', 'request_id': 'req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.604394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd306b9abad5d48c98220cbc4fd288b88', 'request_id': 'req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.616547 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] The token cache is being invalidate because project d306b9abad5d48c98220cbc4fd288b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:47.616838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.617515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.619009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1109/2233] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:47 2022] DELETE /identity/v3/projects/d306b9abad5d48c98220cbc4fd288b88 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:47.623200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:47.633453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f97505-abc2-47d3-a860-2806099a8662 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:47.705338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:47.705338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:47.705338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:47.705338 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] PATH_INFO: `/v3/users/8117186bc6eb4d67aac337f195f0ef7e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:47.705703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8117186bc6eb4d67aac337f195f0ef7e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:47.705703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:47.705703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:47.754466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8117186bc6eb4d67aac337f195f0ef7e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.755183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8117186bc6eb4d67aac337f195f0ef7e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.763505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8117186bc6eb4d67aac337f195f0ef7e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.777268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8117186bc6eb4d67aac337f195f0ef7e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.785191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-95361588-ed3e-47c8-87c0-12f637c58286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8117186bc6eb4d67aac337f195f0ef7e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:47.791719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1125/2234] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:47 2022] DELETE /identity/v3/users/8117186bc6eb4d67aac337f195f0ef7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:48.071929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.073448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:48.086358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ff7f-2971-403a-a780-d8230e7fc3f5 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.146418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.147048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.147355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.147628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] PATH_INFO: `/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.148726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3acd4c0d174f8b9c61b37d2a74f59a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.150645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.159064 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:48.199808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3acd4c0d174f8b9c61b37d2a74f59a', 'request_id': 'req-0e729260-c674-4b41-b140-077b86c71d9e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:48.206972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3acd4c0d174f8b9c61b37d2a74f59a', 'request_id': 'req-0e729260-c674-4b41-b140-077b86c71d9e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:48.212875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3acd4c0d174f8b9c61b37d2a74f59a', 'request_id': 'req-0e729260-c674-4b41-b140-077b86c71d9e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:48.224479 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] The token cache is being invalidate because project bb3acd4c0d174f8b9c61b37d2a74f59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:48.224769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:48.225427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-0e729260-c674-4b41-b140-077b86c71d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:48.226881 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1110/2235] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:48 2022] DELETE /identity/v3/projects/bb3acd4c0d174f8b9c61b37d2a74f59a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:48.231910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.232358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.232482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.252281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:48.253462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:48.312713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1126/2236] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:48.320761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.321076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.321349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.341197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:48.342378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:48.350759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1111/2237] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:48.354929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.364580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076b0d-2393-4524-a35d-3a9fb06756e5 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.369378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.369978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.370257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.370530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.371205 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:48.371511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.373179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.385042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1127/2238] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:48.389242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.398849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8f3ee-36e4-4f01-80f6-9531462c8bac None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.403437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.404019 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.404293 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.404562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.405196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.407728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.434591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1112/2239] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:48.439039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.448893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6834a-0d58-40f0-9110-bbbfe6f0bef1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.505551 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.506142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.506416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.506687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.507334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.509229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.520611 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:48.533629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1128/2240] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:48.537735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.548670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7799be-11b5-47ae-95b1-6c4d96d2d5e7 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.553256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.553846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.554120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.554388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.555015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.556624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.567013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1113/2241] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:48.570819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.580661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fe459-4cad-4b73-8af0-83e0e98a299e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.585154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.585740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.586014 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.586284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.586908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.588504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a708ac2-bcfa-4ed6-82b9-a553d5f1321e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.598868 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1129/2242] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:48.602810 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.613518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bed80-4bd0-4da6-8739-6691c4f3bc3b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.618480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.619275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.619557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.619821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] PATH_INFO: `/v3/projects/c89c8cd74ee940d483d7d31c3de54246/users/765324a86c8b4570b9bc056fc0fdedab/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.635602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89c8cd74ee940d483d7d31c3de54246, user_id=765324a86c8b4570b9bc056fc0fdedab, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.638229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.650284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1114/2243] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:48 2022] PUT /identity/v3/projects/c89c8cd74ee940d483d7d31c3de54246/users/765324a86c8b4570b9bc056fc0fdedab/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:48.661547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.661859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.662145 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.690651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] MFA Rules not processed for user `765324a86c8b4570b9bc056fc0fdedab`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:48.691895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:48.754156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1130/2244] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:48.758758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.819588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6c0b-b414-4e21-988a-92c2d96c2b30 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.824221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.824816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.825095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.825368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.826027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.828012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.856203 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1115/2245] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:48.860945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.872080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9dc51-5c47-46e8-9bed-52e312d27466 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.930824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.931544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.931900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.932255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.932956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.934853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.956467 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1131/2246] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:48 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:48.960123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:48.971057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14f0-786a-4ade-84d8-03027ab406f3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:48.975787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:48.976335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:48.976608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:48.976868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:48.977500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:48.979060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:48.993619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1116/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:48.994739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:49.004742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436da151-2bf2-4179-884d-18545482e3f9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:49.010831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:49.012206 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.012494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.012767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] PATH_INFO: `/v3/projects/978847f1b8954d26a976bf863699be59/users/c956ac9c4c05452894635095ba04d2d2/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.027953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=978847f1b8954d26a976bf863699be59, user_id=c956ac9c4c05452894635095ba04d2d2, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:49.031115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:49.047207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1132/2248] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:48 2022] PUT /identity/v3/projects/978847f1b8954d26a976bf863699be59/users/c956ac9c4c05452894635095ba04d2d2/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:49.051421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:49.061655 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a017-ca14-4bd6-a25e-39e6e42efc33 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:49.065451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:49.119538 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:49.120195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.120422 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.120694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.121319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:49.122892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9692071-9a3a-44c3-bee9-352e0186c8bf admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:49.132913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1117/2249] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:49.137082 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:49.147714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f12e5-e500-4d5c-9d78-e3b5c91749ae admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:49.152324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:49.152964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.153237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.153508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] PATH_INFO: `/v3/projects/978847f1b8954d26a976bf863699be59/users/c956ac9c4c05452894635095ba04d2d2/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.155416 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] RBAC: Authorizing `identity:create_grant(project_id=978847f1b8954d26a976bf863699be59, user_id=c956ac9c4c05452894635095ba04d2d2, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:49.158659 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:49.168706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1133/2250] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:49 2022] PUT /identity/v3/projects/978847f1b8954d26a976bf863699be59/users/c956ac9c4c05452894635095ba04d2d2/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:49.179107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf911-1eef-4892-a934-55359217823f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.179385 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf911-1eef-4892-a934-55359217823f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.179670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf911-1eef-4892-a934-55359217823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.207761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8efaf911-1eef-4892-a934-55359217823f None None] MFA Rules not processed for user `c956ac9c4c05452894635095ba04d2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:49.208956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8efaf911-1eef-4892-a934-55359217823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:49.276010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1118/2251] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:49.289105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:49.290956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:49.321669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:49.352037 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c33b46-7ce5-4597-916e-8b2506ed879d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:49.355637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:49.356237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.356511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.356783 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.365676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:49.367091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998ce44-9f46-4b91-b2ba-ece349c9aa5d service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:49.376391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1134/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:14:49.781790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf911-1eef-4892-a934-55359217823f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:49.844442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf911-1eef-4892-a934-55359217823f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:49.848949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:49.849544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.849819 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.850088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] PATH_INFO: `/v3/users/765324a86c8b4570b9bc056fc0fdedab` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.851219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=765324a86c8b4570b9bc056fc0fdedab)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:49.853137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:49.887544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:49.901654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765324a86c8b4570b9bc056fc0fdedab'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:49.908658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765324a86c8b4570b9bc056fc0fdedab'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:49.915978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765324a86c8b4570b9bc056fc0fdedab'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:49.928832 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765324a86c8b4570b9bc056fc0fdedab'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:49.929472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765324a86c8b4570b9bc056fc0fdedab'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:49.935421 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1119/2253] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:49 2022] DELETE /identity/v3/users/765324a86c8b4570b9bc056fc0fdedab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:49.940826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:49.941133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:49.941409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:49.960018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:49.961262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:50.019720 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1135/2254] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:50.029503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:50.030885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:50.090622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c142a-3b5b-4a7a-b029-06c57426f61f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:50.094405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:50.095056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:50.095478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:50.095747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:50.105349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:50.106760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:50.117741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1120/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:50.414460 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:50.416890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:50.434936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208ef5-f928-4725-8116-a23836abfe8e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:50.444042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:50.444977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:50.445210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:50.445530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] PATH_INFO: `/v3/projects/c89c8cd74ee940d483d7d31c3de54246` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:50.447287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89c8cd74ee940d483d7d31c3de54246)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:50.449877 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:50.510039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89c8cd74ee940d483d7d31c3de54246', 'request_id': 'req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.515823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89c8cd74ee940d483d7d31c3de54246', 'request_id': 'req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.523377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89c8cd74ee940d483d7d31c3de54246', 'request_id': 'req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.536847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] The token cache is being invalidate because project c89c8cd74ee940d483d7d31c3de54246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:50.537137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.537771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.539465 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1136/2256] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:50 2022] DELETE /identity/v3/projects/c89c8cd74ee940d483d7d31c3de54246 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:50.543426 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:50.554773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0e45-1f64-4e30-963b-93b442f583c5 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:50.614761 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:50.615427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:50.615703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:50.615977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] PATH_INFO: `/v3/users/c956ac9c4c05452894635095ba04d2d2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:50.617097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c956ac9c4c05452894635095ba04d2d2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:50.619023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:50.668949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c956ac9c4c05452894635095ba04d2d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.674710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:50.679179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c956ac9c4c05452894635095ba04d2d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.686875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c956ac9c4c05452894635095ba04d2d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.703779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c956ac9c4c05452894635095ba04d2d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.704534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-994648cf-2e84-429b-84e7-1ca31a932398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c956ac9c4c05452894635095ba04d2d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:50.710718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1121/2257] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:50 2022] DELETE /identity/v3/users/c956ac9c4c05452894635095ba04d2d2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:50.988322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:50.989756 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:51.005272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc8f99-75e8-4804-86d1-d16a6bd1ee62 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.057361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:51.068048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.068673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.068971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.069266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] PATH_INFO: `/v3/projects/978847f1b8954d26a976bf863699be59` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.070488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978847f1b8954d26a976bf863699be59)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.072590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.118822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978847f1b8954d26a976bf863699be59', 'request_id': 'req-a3880db3-21c5-482a-add2-c39637485c53'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:51.124250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978847f1b8954d26a976bf863699be59', 'request_id': 'req-a3880db3-21c5-482a-add2-c39637485c53'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:51.130677 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978847f1b8954d26a976bf863699be59', 'request_id': 'req-a3880db3-21c5-482a-add2-c39637485c53'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:51.142446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] The token cache is being invalidate because project 978847f1b8954d26a976bf863699be59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:51.142731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:51.143377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a3880db3-21c5-482a-add2-c39637485c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:51.144823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1137/2258] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:50 2022] DELETE /identity/v3/projects/978847f1b8954d26a976bf863699be59 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:51.149801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.150248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.150611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.171910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:51.173582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:51.231585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1122/2259] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:51.239806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.240092 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.240381 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.259741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:51.260934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:51.269214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1138/2260] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:51.273382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.285435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5e1fc-5534-4787-8842-c86f390ff31e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.290330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.290932 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.291258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.291552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.292177 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:51.292482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.294066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.306173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1123/2261] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:51.310391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.319790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19279f-20b9-4a45-a28b-3f374980aadd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.324424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.325016 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.325292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.325562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.326179 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.328250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.360985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1139/2262] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:51.362132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.373181 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e828c-2c0d-4027-863c-d35051f7b598 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.434664 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.435356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.435586 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.435854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.436471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.438449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.460767 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1124/2263] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:51.464900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.476031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b654-a4f9-4cbc-84c0-81c216174f0f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.480854 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.481449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.481732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.482002 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.482667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.484262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.497028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1140/2264] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:51.498184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.511163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf0d85-a4eb-41ec-ae69-468014af4c59 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.513464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.514070 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.514395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.514666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.515345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.517478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac95b52-be6c-4913-ae72-077c55a41948 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.531167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1125/2265] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:51.535822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.549390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba7ab-c324-456f-9f9e-05746c1f04f8 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.553920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.554594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.554872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.555181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] PATH_INFO: `/v3/projects/acd12712190f4eb08c6a71dcb1a5d390/users/977f92ba8d3d46db8d7e6efbe43b31d3/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.569509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd12712190f4eb08c6a71dcb1a5d390, user_id=977f92ba8d3d46db8d7e6efbe43b31d3, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.572171 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.585187 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1141/2266] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:51 2022] PUT /identity/v3/projects/acd12712190f4eb08c6a71dcb1a5d390/users/977f92ba8d3d46db8d7e6efbe43b31d3/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:51.597260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.597782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.597782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.625373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] MFA Rules not processed for user `977f92ba8d3d46db8d7e6efbe43b31d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:51.626619 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:51.651135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:51.697234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1126/2267] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:51.702074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.763596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa7710-33ea-4094-83b7-b08b44a40de1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.768891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.769494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.769776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.770053 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.770690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.772625 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.798282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1142/2268] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:51.802352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.813458 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b2ba5-6043-40b7-a7ce-c8dbe293a68e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.869121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.869773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.870062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.870331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.870984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.872983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.902198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1127/2269] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:51 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:51.903680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.910778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:51.914583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04ffe9-7fa5-4749-8e0c-1fb567077650 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.921819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.922563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.923195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.923685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.924828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.926172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.937245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1143/2270] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:51.941952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:51.952173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100e4d5-0473-4106-a03d-19b8533bbd30 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:51.957097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:51.957757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:51.958036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:51.958314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] PATH_INFO: `/v3/projects/9ea05f3657404c9b935db69913d1b62b/users/8b81e924ca764e4db4b9f4b73675e307/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:51.975968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea05f3657404c9b935db69913d1b62b, user_id=8b81e924ca764e4db4b9f4b73675e307, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:51.978617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:51.995295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1128/2271] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:51 2022] PUT /identity/v3/projects/9ea05f3657404c9b935db69913d1b62b/users/8b81e924ca764e4db4b9f4b73675e307/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:51.996645 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:52.008428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4b4e3-bcb8-4614-8146-8d4911b09783 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:52.069003 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:52.069608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:52.069894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:52.070168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:52.070804 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:52.072430 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3514-44ef-4828-8e92-8253dc06d290 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:52.082059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1144/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:52.086330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:52.096377 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc95dc-a3bc-4d73-ba57-10085406f161 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:52.100908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:52.101544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:52.101815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:52.102082 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] PATH_INFO: `/v3/projects/9ea05f3657404c9b935db69913d1b62b/users/8b81e924ca764e4db4b9f4b73675e307/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:52.103987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea05f3657404c9b935db69913d1b62b, user_id=8b81e924ca764e4db4b9f4b73675e307, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:52.106565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:52.117510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1129/2273] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:52 2022] PUT /identity/v3/projects/9ea05f3657404c9b935db69913d1b62b/users/8b81e924ca764e4db4b9f4b73675e307/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:52.128110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:52.128417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:52.128696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:52.157689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] MFA Rules not processed for user `8b81e924ca764e4db4b9f4b73675e307`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:52.158922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:52.229661 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1145/2274] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:52.241548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:52.243411 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:52.308225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f218-5c9d-4bed-b9ca-16bbf5973ff0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:52.315053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:52.315720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:52.315998 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:52.316270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:52.349702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:52.379205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:52.380633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:52.389700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1130/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:53.774919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:53.784680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99e3e1-f1f2-44e5-940c-07c669226464 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:53.788166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:53.788758 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:53.789034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:53.789333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:53.798862 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:53.800340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:53.810234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1146/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:57.252954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:57.254362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:57.313854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd212d8-78b2-46d9-a95f-aea9ba30747a service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:57.317298 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:57.317890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:57.318163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:57.318432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:57.320123 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:57.380776 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:57.382179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e62d9f-1138-4049-a1cb-377ea1e0f54d service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:57.392242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1131/2277] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:14:57.602243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:57.612819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9365f7-c9fa-43b4-991d-0aa8805e7f87 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:57.617728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:57.618454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:57.618735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:57.619104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] PATH_INFO: `/v3/users/977f92ba8d3d46db8d7e6efbe43b31d3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:57.620213 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977f92ba8d3d46db8d7e6efbe43b31d3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:57.622153 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:57.671320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977f92ba8d3d46db8d7e6efbe43b31d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.671995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977f92ba8d3d46db8d7e6efbe43b31d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.679791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977f92ba8d3d46db8d7e6efbe43b31d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.681975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:57.694586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977f92ba8d3d46db8d7e6efbe43b31d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.701348 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977f92ba8d3d46db8d7e6efbe43b31d3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.708596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1147/2278] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:57 2022] DELETE /identity/v3/users/977f92ba8d3d46db8d7e6efbe43b31d3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:57.712489 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:57.712792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:57.713088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:57.732060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:57.733259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:57.796877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1132/2279] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:57.806700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:57.808123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:57.868685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d51e0-aec2-423e-b145-48e5dd72d6c1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:57.872771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:57.873490 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:57.873866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:57.874429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:57.885894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:57.890402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902351f6-a609-4863-ae0e-6d5043c86955 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:57.892928 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:57.894367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:57.899477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1148/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:57.906626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f696461-cf67-49dc-b916-b779930118a8 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:57.911395 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:57.912107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:57.912457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:57.912803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] PATH_INFO: `/v3/users/2d74ba154b5f4881be5b934ec85a4977` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:57.914033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d74ba154b5f4881be5b934ec85a4977)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:57.916211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:57.935135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:57.973015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d74ba154b5f4881be5b934ec85a4977'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.981323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d74ba154b5f4881be5b934ec85a4977'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:57.990172 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d74ba154b5f4881be5b934ec85a4977'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.009047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d74ba154b5f4881be5b934ec85a4977'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.009786 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d74ba154b5f4881be5b934ec85a4977'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.017258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1133/2281] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:57 2022] DELETE /identity/v3/users/2d74ba154b5f4881be5b934ec85a4977 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:14:58.021829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:58.022181 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:58.022550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:58.046701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:58.048476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:58.110722 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1149/2282] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:14:58.120602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:58.121930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:58.179984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5892-8004-44e4-b782-a7ddc611ecc1 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:58.183618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:58.184227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:58.184499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:58.184765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:58.194801 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:58.196311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:58.206206 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1134/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:14:58.325397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:58.326989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:58.342288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36149e7-ce88-49b8-beb3-adfba8e4beef None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:58.347805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:58.348624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:58.349011 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:58.349412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] PATH_INFO: `/v3/projects/acd12712190f4eb08c6a71dcb1a5d390` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:58.355633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd12712190f4eb08c6a71dcb1a5d390)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:58.360582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:58.416504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd12712190f4eb08c6a71dcb1a5d390', 'request_id': 'req-c5a537db-4192-460c-9760-b4c81e08be26'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.425048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd12712190f4eb08c6a71dcb1a5d390', 'request_id': 'req-c5a537db-4192-460c-9760-b4c81e08be26'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.433266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd12712190f4eb08c6a71dcb1a5d390', 'request_id': 'req-c5a537db-4192-460c-9760-b4c81e08be26'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.446377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:58.452034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] The token cache is being invalidate because project acd12712190f4eb08c6a71dcb1a5d390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:58.452034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.453010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.458702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1150/2284] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:58 2022] DELETE /identity/v3/projects/acd12712190f4eb08c6a71dcb1a5d390 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:58.460187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:58.473337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea6ef0-b688-4832-8ac0-a8e033b892e7 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:58.546383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:58.547604 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:58.547888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:58.548162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] PATH_INFO: `/v3/users/8b81e924ca764e4db4b9f4b73675e307` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:58.549316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b81e924ca764e4db4b9f4b73675e307)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:58.551321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:58.596899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:58.604754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b81e924ca764e4db4b9f4b73675e307'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.613303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b81e924ca764e4db4b9f4b73675e307'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.621506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b81e924ca764e4db4b9f4b73675e307'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.635519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b81e924ca764e4db4b9f4b73675e307'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.636236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b81e924ca764e4db4b9f4b73675e307'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.642772 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1135/2285] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:58 2022] DELETE /identity/v3/users/8b81e924ca764e4db4b9f4b73675e307 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:58.754286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:58.756091 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:58.783803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a537db-4192-460c-9760-b4c81e08be26 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:58.880283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:58.881185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:58.881582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:58.881955 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] PATH_INFO: `/v3/projects/70b53d4ab18b44c3a95bed7b9ddf2a41` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:58.883367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b53d4ab18b44c3a95bed7b9ddf2a41)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:58.887045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:58.955797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b53d4ab18b44c3a95bed7b9ddf2a41', 'request_id': 'req-57dcf82e-c76d-4e65-ad0f-0415a32477bb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.966724 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b53d4ab18b44c3a95bed7b9ddf2a41', 'request_id': 'req-57dcf82e-c76d-4e65-ad0f-0415a32477bb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.973741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b53d4ab18b44c3a95bed7b9ddf2a41', 'request_id': 'req-57dcf82e-c76d-4e65-ad0f-0415a32477bb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.996019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] The token cache is being invalidate because project 70b53d4ab18b44c3a95bed7b9ddf2a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:58.996317 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:58.996941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.004041 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.004558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1151/2286] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:58 2022] DELETE /identity/v3/projects/70b53d4ab18b44c3a95bed7b9ddf2a41 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:59.005503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:59.017929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.020581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:59.024777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22452ddc-6d33-4823-8b9b-165305970187 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.127932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf82e-c76d-4e65-ad0f-0415a32477bb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.140049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.142109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.142271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.142549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] PATH_INFO: `/v3/projects/9ea05f3657404c9b935db69913d1b62b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.145541 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea05f3657404c9b935db69913d1b62b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.149309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.157030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.157686 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.157964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.158229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] PATH_INFO: `/v3/users/984e2900d0724057b1537fc632b74ab7` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.162735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984e2900d0724057b1537fc632b74ab7)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.164898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.221353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:59.254360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea05f3657404c9b935db69913d1b62b', 'request_id': 'req-8f389c90-f051-4f0e-abbb-46631ea3225f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.259650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984e2900d0724057b1537fc632b74ab7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.269421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea05f3657404c9b935db69913d1b62b', 'request_id': 'req-8f389c90-f051-4f0e-abbb-46631ea3225f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.273258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984e2900d0724057b1537fc632b74ab7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.279791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea05f3657404c9b935db69913d1b62b', 'request_id': 'req-8f389c90-f051-4f0e-abbb-46631ea3225f'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.304918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984e2900d0724057b1537fc632b74ab7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.326883 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] The token cache is being invalidate because project 9ea05f3657404c9b935db69913d1b62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:14:59.327207 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.330518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8f389c90-f051-4f0e-abbb-46631ea3225f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.338649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1152/2287] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:59 2022] DELETE /identity/v3/projects/9ea05f3657404c9b935db69913d1b62b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:59.338833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984e2900d0724057b1537fc632b74ab7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.338833 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-31b98d68-1111-48ab-a234-384a03237158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984e2900d0724057b1537fc632b74ab7'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:14:59.340284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.340564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.340835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.358895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1136/2288] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:14:59 2022] DELETE /identity/v3/users/984e2900d0724057b1537fc632b74ab7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:59.369676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:59.370993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:59.452224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1153/2289] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:14:59.461338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.461897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.461897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.487969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:14:59.489320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:59.505466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1137/2290] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:14:59.510072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.525670 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1c27-601e-4f63-8f55-1b571b604bed None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.539576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.540268 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.540869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.540869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.541520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:14:59.541822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.543526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.580449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1154/2291] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:14:59.584416 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.595793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af7418-bf41-43d0-b1f6-c6f436db7122 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.604610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.605243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.605519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.605789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.606444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.608381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.650589 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1138/2292] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:14:59 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:14:59.651784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.662197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0973a-73ac-409c-92be-26896d2f8973 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.730229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.731487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.731865 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.732235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.732981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.735678 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.764491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1155/2293] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:14:59 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:14:59.768941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.781842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9e9d-12e0-4d11-9ce9-0dc25dc6c3b2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.788483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.789207 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.789608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.790030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.790947 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.793060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.794710 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:14:59.813124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.818169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1139/2294] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:14:59.826075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9352-7d7e-47e6-99bc-b7aac0efc938 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.831208 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.832042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.832464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.832844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.834193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.836408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.858355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1156/2295] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:14:59.863517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.875892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352bce-3cce-40d5-b897-2402fe2535a6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.881135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:14:59.881740 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.882009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.882270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] PATH_INFO: `/v3/projects/6a2a7c41112c4f51b930c98c01163fa6/users/b52270a418214923b711f43136107e70/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.898614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2a7c41112c4f51b930c98c01163fa6, user_id=b52270a418214923b711f43136107e70, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:14:59.903007 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e0e4-8f95-4ce1-91c4-d848f5618611 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:14:59.908295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:14:59.910041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:14:59.929946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1140/2296] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:14:59 2022] PUT /identity/v3/projects/6a2a7c41112c4f51b930c98c01163fa6/users/b52270a418214923b711f43136107e70/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:14:59.941144 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:14:59.941909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:14:59.942382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:14:59.950076 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d5c6-576f-4491-bedf-66726e1c319a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:14:59.990224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:00.017189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] MFA Rules not processed for user `b52270a418214923b711f43136107e70`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:00.018425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.042581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.043368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.043912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.044075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] PATH_INFO: `/v3/projects/51995c583d344041b04ff04836bf7253` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.045237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=51995c583d344041b04ff04836bf7253)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.048343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.098577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1141/2297] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:14:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:00.102920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.103119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51995c583d344041b04ff04836bf7253', 'request_id': 'req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:00.109068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51995c583d344041b04ff04836bf7253', 'request_id': 'req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:00.114446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2a34-ec21-4ffc-8085-6a29f17472fd None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.116390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51995c583d344041b04ff04836bf7253', 'request_id': 'req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:00.132711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] The token cache is being invalidate because project 51995c583d344041b04ff04836bf7253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:00.133257 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:00.134116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a2f6fed2-ad3d-4b78-ad97-6421d6d3c4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:00.135980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1157/2298] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:14:59 2022] DELETE /identity/v3/projects/51995c583d344041b04ff04836bf7253 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:00.140607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577461fb-1880-41b0-b7ec-8e9c6bb29cf3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.141084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577461fb-1880-41b0-b7ec-8e9c6bb29cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.141562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577461fb-1880-41b0-b7ec-8e9c6bb29cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.162683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-577461fb-1880-41b0-b7ec-8e9c6bb29cf3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:00.163988 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-577461fb-1880-41b0-b7ec-8e9c6bb29cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.183675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.184221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.184491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.185110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.185518 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.188118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.227628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1142/2299] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:00.232094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.233750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.235634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1158/2300] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:00.243442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.243733 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.244851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.268757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:00.269948 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.299933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:00.329785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831d80-7d9f-4842-bce3-fb15d2c23202 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.335197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:00.340405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.341112 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.341320 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.341588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.342226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.344764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.354832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1159/2301] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:00.360075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.371042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1143/2302] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:00.374727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.376605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d155d0e-3f9b-4f35-8da7-11b134309ef5 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.382895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.384214 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.384513 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.384838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.385504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:00.385811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.387446 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.391304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffba48-b0e2-482e-91a5-bf437109718e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.396115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.396734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.397008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.397276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.398167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.400122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.406900 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1160/2303] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:15:00.411159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.416802 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1144/2304] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:00.421332 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.428368 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a0b9-9a2c-41e8-b579-2f449c141749 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.433986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.434204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1760c6-99b5-48a8-908d-ab24c8ecdc6e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.434711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.434994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.435363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.436114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.438747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.439812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.440475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.440754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.441030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] PATH_INFO: `/v3/projects/187628e1d1204537b56ca8efa4219f17/users/c375cf4fa05e4b768f705d86e4d38360/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.459205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187628e1d1204537b56ca8efa4219f17, user_id=c375cf4fa05e4b768f705d86e4d38360, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.462741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.478654 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1145/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:00 2022] PUT /identity/v3/projects/187628e1d1204537b56ca8efa4219f17/users/c375cf4fa05e4b768f705d86e4d38360/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:00.480931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1161/2306] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:00.486028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.486719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.570553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a086a7-9eb4-41ae-abc0-579173b66f5e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.575523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.576138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.576415 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.576694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.577330 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.579826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.592495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a478eb-4c7d-4afb-86c2-96e8eb7b28b4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.599636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.600382 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.600781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.601155 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.602927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.605391 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.606571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1162/2307] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:00.611655 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.627907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68ac6-c73d-49fb-a534-b0e365b6aadd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.631920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1146/2308] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:00.633335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.635026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.635774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.636157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.636500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.637260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.638963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.654947 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1163/2309] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:00.657698 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.659354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280e15-103f-4170-aed0-807523bee404 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.664803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.666251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.666645 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.667095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] PATH_INFO: `/v3/projects/187628e1d1204537b56ca8efa4219f17/users/c375cf4fa05e4b768f705d86e4d38360/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.670757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99af78-564e-4b40-953c-a54632e6f719 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.676149 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.676269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] RBAC: Authorizing `identity:create_grant(project_id=187628e1d1204537b56ca8efa4219f17, user_id=c375cf4fa05e4b768f705d86e4d38360, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.676654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.677147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.677427 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.678122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.678788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27318-262d-482d-842a-b8113c77803c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.679707 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.694255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1164/2310] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:00.697367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1147/2311] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:00 2022] PUT /identity/v3/projects/187628e1d1204537b56ca8efa4219f17/users/c375cf4fa05e4b768f705d86e4d38360/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:00.701040 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.707986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.709060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.709467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.714871 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd95cdf-7f80-4b53-8ab8-1da2bf9da465 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:00.762466 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] MFA Rules not processed for user `c375cf4fa05e4b768f705d86e4d38360`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:00.763739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.808325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:00.809009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.809388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.809663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] PATH_INFO: `/v3/projects/3820bc0b2d6947feab305575e6948bcb/users/2d2e157bbcd94cc28e034aa61339efaa/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.831442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3820bc0b2d6947feab305575e6948bcb, user_id=2d2e157bbcd94cc28e034aa61339efaa, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:00.835200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3db6d-6c45-48b0-b4a7-c591e842b38d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:00.861281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1165/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:00 2022] PUT /identity/v3/projects/3820bc0b2d6947feab305575e6948bcb/users/2d2e157bbcd94cc28e034aa61339efaa/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:00.872961 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:00.873433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:00.873718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:00.889962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1148/2313] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:00.901989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:00.903419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.919428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:00.919586 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:00.933951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] MFA Rules not processed for user `2d2e157bbcd94cc28e034aa61339efaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:00.935278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:00.984485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af91d21-74a1-4d5d-aec4-dcf1de919d66 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.040245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1166/2314] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:01.044462 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.060996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.061707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.063047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.063047 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.173685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf574bc-8848-4245-8ac0-418d93015593 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.179219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.179830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.180105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.180402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.181038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.182929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.190519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.193197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.207199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1149/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:01.231943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1167/2316] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:01 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:01.236328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.257407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1eb97-3e42-4a73-aee7-936380e0e662 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.259635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.267283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.351506 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c500c-0db8-439e-9962-3af50350e537 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.356477 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.357118 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.357399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.357787 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.357940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.358309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.358539 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.358815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.359103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] PATH_INFO: `/v3/users/5ba37660a05e44f5a7f10946e79cb250` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.360300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba37660a05e44f5a7f10946e79cb250)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.360429 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.362196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.392931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1150/2317] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:01 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:01.392931 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.397644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:01.401337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c0e2e-9b62-4a78-8408-ce7540ac0a7e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.402694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:01.407872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.408567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.409785 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.410400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] PATH_INFO: `/v3/users/b52270a418214923b711f43136107e70` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.411736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52270a418214923b711f43136107e70)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.414449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.422288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba37660a05e44f5a7f10946e79cb250'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.423204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba37660a05e44f5a7f10946e79cb250'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.432062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba37660a05e44f5a7f10946e79cb250'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.448827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba37660a05e44f5a7f10946e79cb250'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.461103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba37660a05e44f5a7f10946e79cb250'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.472194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1168/2318] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:01 2022] DELETE /identity/v3/users/5ba37660a05e44f5a7f10946e79cb250 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:01.473061 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.474523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.477548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52270a418214923b711f43136107e70'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.491299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52270a418214923b711f43136107e70'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.504501 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52270a418214923b711f43136107e70'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.539295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52270a418214923b711f43136107e70'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.540816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5744240d-d2c9-4291-8f75-e3f23dffc28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52270a418214923b711f43136107e70'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.552789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1151/2319] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:01 2022] DELETE /identity/v3/users/b52270a418214923b711f43136107e70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:01.557450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.557726 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.558000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.579557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e687b3-e81d-450c-949c-7f51d12d65ac admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.583566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:01.584630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.646892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.647573 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.647903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.648301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.649434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.651646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.653265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1152/2320] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:01.665609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.669262 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1169/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:01.669378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.671888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.674034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.688141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6d7eb-2872-4ed9-9985-9e77e0bc8386 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.693585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.694260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.694536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.694820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] PATH_INFO: `/v3/projects/8ce51af4f53a461589f1ca3f345850f3/users/9452ee7991594bdf9db900a2d28ffaf1/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.716835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce51af4f53a461589f1ca3f345850f3, user_id=9452ee7991594bdf9db900a2d28ffaf1, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.720587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.732388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522bce8-f2a2-4c39-84ee-cf47cbf307c3 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.738030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1170/2322] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:01 2022] PUT /identity/v3/projects/8ce51af4f53a461589f1ca3f345850f3/users/9452ee7991594bdf9db900a2d28ffaf1/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:01.738911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.740848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.765612 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:01.774165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:01.789269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.789883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.790161 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.790435 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.811943 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91503c-4b93-44de-a3f0-8a770f441620 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.817488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.818116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.818398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.818673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] PATH_INFO: `/v3/projects/e506ce73a94e41639f8640865d0fa13b` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.819819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e506ce73a94e41639f8640865d0fa13b)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.821723 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.852137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.853618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.864145 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1153/2323] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:01.865136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.870371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e506ce73a94e41639f8640865d0fa13b', 'request_id': 'req-0825c89f-de31-4f7e-9e98-d76bb4b158b0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.874576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b2ca-eeaf-4a5b-a67b-e9ebbdc3ab85 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.877183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e506ce73a94e41639f8640865d0fa13b', 'request_id': 'req-0825c89f-de31-4f7e-9e98-d76bb4b158b0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.885074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e506ce73a94e41639f8640865d0fa13b', 'request_id': 'req-0825c89f-de31-4f7e-9e98-d76bb4b158b0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.898992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] The token cache is being invalidate because project e506ce73a94e41639f8640865d0fa13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:01.899313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.899960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-0825c89f-de31-4f7e-9e98-d76bb4b158b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:01.901495 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1171/2324] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:01 2022] DELETE /identity/v3/projects/e506ce73a94e41639f8640865d0fa13b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:01.906615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95bef-f4e3-4487-8536-b377664e3992 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.906774 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95bef-f4e3-4487-8536-b377664e3992 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.907021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95bef-f4e3-4487-8536-b377664e3992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.928323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-18b95bef-f4e3-4487-8536-b377664e3992 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:01.929550 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-18b95bef-f4e3-4487-8536-b377664e3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.942209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.942940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.943163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.943432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.944068 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.945658 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.956825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1154/2325] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:01.961011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:01.962842 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:01.976515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a11b7-8044-4392-a03d-838858b88fad admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:01.980606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:01.981271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:01.981555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:01.981843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] PATH_INFO: `/v3/projects/8ce51af4f53a461589f1ca3f345850f3/users/9452ee7991594bdf9db900a2d28ffaf1/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:01.983798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce51af4f53a461589f1ca3f345850f3, user_id=9452ee7991594bdf9db900a2d28ffaf1, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:01.987141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc671d3d-86d2-4bea-bdff-f9448c06fa6b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:01.998738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1155/2326] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:01 2022] PUT /identity/v3/projects/8ce51af4f53a461589f1ca3f345850f3/users/9452ee7991594bdf9db900a2d28ffaf1/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:02.011325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1172/2327] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:02.011525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.011525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.011525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.012694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.012981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.013254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.039218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:02.040502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.042254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] MFA Rules not processed for user `9452ee7991594bdf9db900a2d28ffaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:02.043576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.095240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:02.113271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1173/2328] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:02.113722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:02.115483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.126225 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b4bd6-9340-492f-a3bb-2f58cc0eb917 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.131617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.132372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.132752 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.133146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.133899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:02.134407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.136034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.141126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1156/2329] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:02.152548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.153775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1174/2330] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:15:02.155689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.158742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.173453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f87b7-f249-44e9-8304-474a00ab4315 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.178933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.179919 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.180411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.180920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.181745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.183945 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.220022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1175/2331] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:02 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:02.224280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.227471 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a076935-3117-4a4f-919d-cbae9c9d3c96 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.294514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e7ea0-3f1a-4ddb-8bd9-c4a9f497b6c5 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.294803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.295815 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.296187 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.296630 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.298715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.300235 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.300852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.301125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.301399 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.302034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.304012 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.330609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1176/2332] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:02 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:02.335197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.345782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f4da-47c9-41e3-8448-182983578548 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.350918 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.351508 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.351765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.352054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.352736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.354390 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.365422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1177/2333] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:02.369258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.373841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.376066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.379759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e2fa-39a6-4881-b358-f756488c4a4b admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.386208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1157/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:02.391407 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.392030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.392309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.392581 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.393224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.394826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.406517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1178/2335] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:02.411321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.422722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012451-fb2c-44b4-83c4-59103c0b4e1b service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.434524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.437838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.437838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.437838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] PATH_INFO: `/v3/projects/0d8166ca7798414c9b8749180ba858cf/users/3c9b0c49584d482ab5779cfd1a4a9968/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.438151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.439017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.454419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363b635-0cf2-41fa-a056-fe024b8f3196 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.459886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8166ca7798414c9b8749180ba858cf, user_id=3c9b0c49584d482ab5779cfd1a4a9968, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.462576 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999a945-f39a-4664-ba7a-4fa5e35d8aa3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.473986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.474702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.474930 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.475248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] PATH_INFO: `/v3/projects/6a2a7c41112c4f51b930c98c01163fa6` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.476568 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2a7c41112c4f51b930c98c01163fa6)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.478514 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.488242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1158/2336] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:02 2022] PUT /identity/v3/projects/0d8166ca7798414c9b8749180ba858cf/users/3c9b0c49584d482ab5779cfd1a4a9968/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:02.498333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.498617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.498890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.534529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] MFA Rules not processed for user `3c9b0c49584d482ab5779cfd1a4a9968`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:02.535820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.552057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2a7c41112c4f51b930c98c01163fa6', 'request_id': 'req-57b3d2dd-814b-40ca-bf37-0c9b15338e88'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.559822 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2a7c41112c4f51b930c98c01163fa6', 'request_id': 'req-57b3d2dd-814b-40ca-bf37-0c9b15338e88'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.566781 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:02.567827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2a7c41112c4f51b930c98c01163fa6', 'request_id': 'req-57b3d2dd-814b-40ca-bf37-0c9b15338e88'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.584911 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] The token cache is being invalidate because project 6a2a7c41112c4f51b930c98c01163fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:02.585261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.585933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.587739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1179/2337] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:02 2022] DELETE /identity/v3/projects/6a2a7c41112c4f51b930c98c01163fa6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:02.592160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.594259 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.608718 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:02.614198 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1159/2338] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:02.626374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:02.628773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:02.675110 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3d2dd-814b-40ca-bf37-0c9b15338e88 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.680080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.680735 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.681010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.681281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] PATH_INFO: `/v3/users/c375cf4fa05e4b768f705d86e4d38360` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.682632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c375cf4fa05e4b768f705d86e4d38360)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.684976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.718344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3671a-b943-4b86-891b-c9ff55c2fee1 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:02.726867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:02.727628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:02.727929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:02.728309 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:02.737140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c375cf4fa05e4b768f705d86e4d38360'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.737833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c375cf4fa05e4b768f705d86e4d38360'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.739292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:02.741044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:02.746929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c375cf4fa05e4b768f705d86e4d38360'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.751037 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1160/2339] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:02.764982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c375cf4fa05e4b768f705d86e4d38360'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.777131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-4793d803-a03c-46d1-ba16-babd452b1a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c375cf4fa05e4b768f705d86e4d38360'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:02.787797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1180/2340] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:02 2022] DELETE /identity/v3/users/c375cf4fa05e4b768f705d86e4d38360 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:03.112035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.133350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8de2c-21b7-4bfe-a771-9ed4f84c65fc service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.197696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.198367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.198646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.198921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] PATH_INFO: `/v3/projects/187628e1d1204537b56ca8efa4219f17` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.200108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187628e1d1204537b56ca8efa4219f17)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.202038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.250834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187628e1d1204537b56ca8efa4219f17', 'request_id': 'req-67966967-9b87-4693-8186-a3ef5bb68289'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:03.254308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:03.258953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187628e1d1204537b56ca8efa4219f17', 'request_id': 'req-67966967-9b87-4693-8186-a3ef5bb68289'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:03.267225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187628e1d1204537b56ca8efa4219f17', 'request_id': 'req-67966967-9b87-4693-8186-a3ef5bb68289'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:03.278618 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] The token cache is being invalidate because project 187628e1d1204537b56ca8efa4219f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:03.278907 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:03.279636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-67966967-9b87-4693-8186-a3ef5bb68289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:03.281390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1161/2341] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:03 2022] DELETE /identity/v3/projects/187628e1d1204537b56ca8efa4219f17 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:03.287473 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.288098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.288098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.308634 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:03.309843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:03.373275 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1181/2342] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:03.382666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.382957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.383260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.404285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:03.405667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:03.413650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1162/2343] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:03.417699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.428006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46b07-25bd-480b-b544-5b348f27b237 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.432736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.433327 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.433605 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.433876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.434516 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:03.434849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.436449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.448916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1182/2344] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:15:03.453394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.462568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc324ea-c9de-4e43-92e1-0246433d832a None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.467256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.467847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.468127 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.468400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.469033 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.470919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.497242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1163/2345] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:03.502094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.511831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2320e12-d581-4f1b-984f-b0f7cc5d6a63 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.529142 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:03.571298 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.571894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.572174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.572448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.573100 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.574986 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.596107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1183/2346] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:03.600328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.611001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ef9f-8308-496a-98c4-19684339f4bc admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.615529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.616117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.616392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.616662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.617325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.618890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.629714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1164/2347] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:03.633560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.643867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a85eb9-5d46-4311-8e53-05073f9f9d80 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.648396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.648979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.649256 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.649556 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.650184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.651809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f554-64dd-4bea-a14c-80f3708da6dc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.662684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1184/2348] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:03.666711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.677488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1d4a-c567-40f4-a75d-74cb089fab1b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.681965 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.682596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.682868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.683173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] PATH_INFO: `/v3/projects/1533543c857e4d29a5143e5f4da96c08/users/9b84de5727b942e0a5307fb2e18ea738/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.697442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1533543c857e4d29a5143e5f4da96c08, user_id=9b84de5727b942e0a5307fb2e18ea738, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.700111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.712465 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1165/2349] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:03 2022] PUT /identity/v3/projects/1533543c857e4d29a5143e5f4da96c08/users/9b84de5727b942e0a5307fb2e18ea738/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:03.722946 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.723254 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.723530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.751241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] MFA Rules not processed for user `9b84de5727b942e0a5307fb2e18ea738`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:03.752492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:03.814795 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1185/2350] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:03.819168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.882546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a0a81-6fe5-4756-a4fe-352e2103d1a8 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.887044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.887674 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.887950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.888218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.888844 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.890733 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:03.921221 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1166/2351] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:03.924136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:03.935487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4302-fe9d-49d2-8112-a9f7b6b8cb54 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:03.993864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:03.994468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:03.994744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:03.995015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:03.995666 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:03.997561 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.019922 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1186/2352] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:03 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:04.023528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.034878 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f7a6-2ae1-4ff5-984d-6a14d9d97888 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.039692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.040340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.040669 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.040940 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.041570 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.043263 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.055993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1167/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:04.060544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.071111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc8916-ff89-4ce7-aff2-0d0c8a30d154 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.076233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.076891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.077174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.077450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] PATH_INFO: `/v3/projects/61240edf4e91421a9f359f4876ebd10e/users/37057375c2974a1484212f7593c139eb/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.093351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61240edf4e91421a9f359f4876ebd10e, user_id=37057375c2974a1484212f7593c139eb, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.096665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.098790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:04.111445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1187/2354] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:04 2022] PUT /identity/v3/projects/61240edf4e91421a9f359f4876ebd10e/users/37057375c2974a1484212f7593c139eb/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:04.115582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.125598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655608ae-662e-4cc1-b2fa-c625e4a02f1e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.185355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:04.197393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.198292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.198292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.198553 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.199485 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.201304 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e332ef3-9be8-40f5-a655-719fb6da4cca admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.215428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1168/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:04.218031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.229926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4227b-08d9-41af-8b98-7d75edd6478d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.235432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.236160 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.236596 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.236982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] PATH_INFO: `/v3/projects/61240edf4e91421a9f359f4876ebd10e/users/37057375c2974a1484212f7593c139eb/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.239021 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61240edf4e91421a9f359f4876ebd10e, user_id=37057375c2974a1484212f7593c139eb, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.241920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.263595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1188/2356] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:04 2022] PUT /identity/v3/projects/61240edf4e91421a9f359f4876ebd10e/users/37057375c2974a1484212f7593c139eb/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:04.267948 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.268231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.268505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.300835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] MFA Rules not processed for user `37057375c2974a1484212f7593c139eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:04.302055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:04.379272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1169/2357] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:04.391005 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.392769 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:04.461261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9265f-efe6-4e31-9562-2ff078e9490a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.465510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.465985 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.466419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.466624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.482354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.483825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.494323 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1189/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:04.576724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.587822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66c96a-b6c6-4199-9dc6-1c8c53eadf84 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.591359 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.591950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.592222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.592494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.651363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.652770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae6f10-6e2a-44aa-85d1-3512bd1081a6 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:04.662069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1170/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:04.923576 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:04.985601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bc06f-6165-4aa4-8ee5-3213b018762d service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:04.990009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:04.990620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:04.990893 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:04.991196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] PATH_INFO: `/v3/users/9b84de5727b942e0a5307fb2e18ea738` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:04.992286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b84de5727b942e0a5307fb2e18ea738)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:04.994170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:05.039940 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b84de5727b942e0a5307fb2e18ea738'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.040523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b84de5727b942e0a5307fb2e18ea738'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.048343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b84de5727b942e0a5307fb2e18ea738'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.060071 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b84de5727b942e0a5307fb2e18ea738'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.067431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b84de5727b942e0a5307fb2e18ea738'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.073167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1190/2360] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:04 2022] DELETE /identity/v3/users/9b84de5727b942e0a5307fb2e18ea738 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:05.077753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:05.078076 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:05.078350 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:05.096971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:05.098169 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:05.157868 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1171/2361] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:05.167601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:05.169039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:05.175355 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:05.229191 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f26bde-ae14-4310-b1a2-c84b3f1b5b69 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:05.232870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:05.233458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:05.233736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:05.234026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:05.243872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:05.245487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:05.255475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1191/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:05.551442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:05.555768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:05.574165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386d07e-bb37-438f-9705-3673f36c0ec9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:05.580475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:05.581105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:05.582628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:05.583137 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] PATH_INFO: `/v3/projects/1533543c857e4d29a5143e5f4da96c08` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:05.584846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1533543c857e4d29a5143e5f4da96c08)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:05.588230 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:05.608790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:05.661796 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1533543c857e4d29a5143e5f4da96c08', 'request_id': 'req-fedaf47c-3121-4f32-a5db-fc76a39ff51a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.670355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1533543c857e4d29a5143e5f4da96c08', 'request_id': 'req-fedaf47c-3121-4f32-a5db-fc76a39ff51a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.676904 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1533543c857e4d29a5143e5f4da96c08', 'request_id': 'req-fedaf47c-3121-4f32-a5db-fc76a39ff51a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.688856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] The token cache is being invalidate because project 1533543c857e4d29a5143e5f4da96c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:05.689149 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.689867 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.691977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1172/2363] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:05 2022] DELETE /identity/v3/projects/1533543c857e4d29a5143e5f4da96c08 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:05.696194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:05.707316 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26301c-cd43-4bcf-bce9-a7e609fbc7ac service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:05.775048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:05.775699 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:05.775973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:05.776244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] PATH_INFO: `/v3/users/37057375c2974a1484212f7593c139eb` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:05.777340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37057375c2974a1484212f7593c139eb)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:05.779376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:05.825852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37057375c2974a1484212f7593c139eb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.826421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37057375c2974a1484212f7593c139eb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.834189 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37057375c2974a1484212f7593c139eb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.846995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37057375c2974a1484212f7593c139eb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.853987 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-8e580de9-0fc1-4af7-8edd-2bbfb460e697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37057375c2974a1484212f7593c139eb'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:05.861686 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1192/2364] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:05 2022] DELETE /identity/v3/users/37057375c2974a1484212f7593c139eb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:06.136167 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.137831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.151606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf47c-3121-4f32-a5db-fc76a39ff51a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.215099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.215719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.215993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.216260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] PATH_INFO: `/v3/projects/61240edf4e91421a9f359f4876ebd10e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.217355 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61240edf4e91421a9f359f4876ebd10e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.219319 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.264219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61240edf4e91421a9f359f4876ebd10e', 'request_id': 'req-78880004-e4d0-4889-8872-776b04812b56'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:06.272410 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61240edf4e91421a9f359f4876ebd10e', 'request_id': 'req-78880004-e4d0-4889-8872-776b04812b56'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:06.278049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61240edf4e91421a9f359f4876ebd10e', 'request_id': 'req-78880004-e4d0-4889-8872-776b04812b56'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:06.290502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] The token cache is being invalidate because project 61240edf4e91421a9f359f4876ebd10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:06.290788 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:06.291451 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-78880004-e4d0-4889-8872-776b04812b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:06.292918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1173/2365] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:06 2022] DELETE /identity/v3/projects/61240edf4e91421a9f359f4876ebd10e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:06.298623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.299290 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.299571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.319309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:06.320496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.338910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:06.380982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1193/2366] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:06.445107 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.445384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.445662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.465200 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:06.466403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.474499 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1174/2367] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:06.478626 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.488618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac734d-51ea-473b-96d3-054bedf90643 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.493219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.493810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.494087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.494360 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.494999 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:06.495333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.496888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.508810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1194/2368] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:06.513066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.522306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e90c3-77d5-4103-8e23-01a0a3a9d09e None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.527008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.527754 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.527970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.528162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.528803 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.530737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.552025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:06.560649 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1175/2369] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:06.565547 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.575610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb050f4-2430-4ec9-ba46-f24d89d31a2c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.641859 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.642018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.642234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.642511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.643185 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.645104 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.666976 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1195/2370] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:06.671495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.682960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e12e-89f6-41dc-8499-c2804fe36085 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.687751 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.688334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.688606 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.688877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.689502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.691135 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.701321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1176/2371] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:06.705239 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.715059 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339873b-24f6-4b35-8ae7-efcb7d596f24 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.720177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.720776 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.721056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.721326 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.721960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.723562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.734828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1196/2372] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:06.743340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.749231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e5ff-f046-4260-b9dc-45459a5d228e admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.753976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.754623 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.754901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.755208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] PATH_INFO: `/v3/projects/d5f395beec6248288b902b678878a141/users/4a65b41189ad4647919646bd99a6c20e/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.758522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.760220 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.772890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f395beec6248288b902b678878a141, user_id=4a65b41189ad4647919646bd99a6c20e, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.775791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9b10-0f0c-492b-812e-79a3d6c4d99b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.791114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1177/2373] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:06 2022] PUT /identity/v3/projects/d5f395beec6248288b902b678878a141/users/4a65b41189ad4647919646bd99a6c20e/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:06.801497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.801783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.804678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.829904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36917c-9cb0-407c-84b1-d9d112849208 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.835762 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] MFA Rules not processed for user `4a65b41189ad4647919646bd99a6c20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:06.837213 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.884899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:06.892604 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.893274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.893571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.894070 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.897087 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:06.913574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1178/2374] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:06.918054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:06.971929 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.973367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:06.983204 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1197/2375] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:06.985526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905dda-6dcc-472f-be9f-870c6c2d9b81 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:06.990226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:06.990840 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:06.991209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:06.991483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:06.992205 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:06.993978 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.025746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1179/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:06 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:07.027805 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.039711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7e86-0233-4f0b-84c6-2e82b546d1cd service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.102898 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.103712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.104054 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.104435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.105141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.108141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.132022 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1198/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:07 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:07.136055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.146863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa590606-cbdc-41ac-9c66-374beabd6944 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.152583 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.153598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.153903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.154256 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.154812 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.156513 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.167212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1180/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:07.171421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.182503 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1f08-17b0-4522-8178-9f36fc85283f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.187832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.188555 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.188831 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.189115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.189844 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.191577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69697d02-cc79-409f-938e-f3389635b97b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.203504 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1199/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:07.207798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.218182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddad9-2875-4a7c-a548-e6bb5f1a6835 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.223143 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.224079 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.224442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.224826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] PATH_INFO: `/v3/projects/fe739b64469e47e69e6dd11f01729746/users/391a5807da2b47e1b14b511c8ace0cc8/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.241855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe739b64469e47e69e6dd11f01729746, user_id=391a5807da2b47e1b14b511c8ace0cc8, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.244667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.260337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1181/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:07 2022] PUT /identity/v3/projects/fe739b64469e47e69e6dd11f01729746/users/391a5807da2b47e1b14b511c8ace0cc8/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:07.271154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.271450 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.271730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.303409 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] MFA Rules not processed for user `391a5807da2b47e1b14b511c8ace0cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:07.304631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:07.369174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1200/2381] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:07.373828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.379854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:07.441967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7d542-fa34-4ccd-bf9a-a8147416e5f9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.446946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.447571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.447845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.448131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.448736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.450980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.478219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1182/2382] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:07 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:07.482279 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.489542 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:07.493901 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca894e5-c953-44e8-bb9d-1f43668909d9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.552369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.552979 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.553255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.553529 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.554167 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.556140 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.576583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1201/2383] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:07 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:07.580640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.590963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de039e-60f6-42b0-bc9d-a91d717dd7df admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.596419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.597018 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.597296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.597571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.598208 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.599880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.612836 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1183/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:07.617354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.627367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73b57-4a0e-462b-896f-ea384f75ecbc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.631933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.632580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.632855 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.633125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] PATH_INFO: `/v3/projects/d61c60853f4b4de9b44e19578e8f0b37/users/f924951328aa42d7ab1dcdc83c58ee40/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.647827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61c60853f4b4de9b44e19578e8f0b37, user_id=f924951328aa42d7ab1dcdc83c58ee40, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.650470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.663297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1202/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:07 2022] PUT /identity/v3/projects/d61c60853f4b4de9b44e19578e8f0b37/users/f924951328aa42d7ab1dcdc83c58ee40/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:07.668450 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.679215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad62e-178a-4b03-b0a2-c9e7ca412fb4 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.735291 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.735901 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.736175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.736442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.737066 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.738646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd88e6-aef6-4067-a859-9a86af7fcfb1 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.748191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1184/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:07.752609 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.762813 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ef96-39ea-44e2-bad4-3c29ef3814bb admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.767888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.768526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.768799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.769069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] PATH_INFO: `/v3/projects/d61c60853f4b4de9b44e19578e8f0b37/users/f924951328aa42d7ab1dcdc83c58ee40/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.770942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61c60853f4b4de9b44e19578e8f0b37, user_id=f924951328aa42d7ab1dcdc83c58ee40, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:07.773567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:07.784391 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1203/2387] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:07 2022] PUT /identity/v3/projects/d61c60853f4b4de9b44e19578e8f0b37/users/f924951328aa42d7ab1dcdc83c58ee40/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:07.794159 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75fc1-9e29-4103-a192-be178366874b None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.794443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75fc1-9e29-4103-a192-be178366874b None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.794716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75fc1-9e29-4103-a192-be178366874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:07.821872 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-30a75fc1-9e29-4103-a192-be178366874b None None] MFA Rules not processed for user `f924951328aa42d7ab1dcdc83c58ee40`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:07.823193 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-30a75fc1-9e29-4103-a192-be178366874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:07.885757 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:07.892541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1185/2388] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:07.904372 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:07.959135 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a632d8-5a99-49d4-ab9c-a367ecf76fa0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:07.962808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:07.963616 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:07.963895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:07.964322 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.035039 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:08.037620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464082f-9004-4aa7-9dab-b5287f6e4596 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:08.047739 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1204/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:08.098236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75fc1-9e29-4103-a192-be178366874b None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:08.098236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-30a75fc1-9e29-4103-a192-be178366874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:08.162313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75fc1-9e29-4103-a192-be178366874b None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:08.166846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:08.167500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.167778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.168049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] PATH_INFO: `/v3/users/3c9b0c49584d482ab5779cfd1a4a9968` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.169822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9b0c49584d482ab5779cfd1a4a9968)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:08.172567 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:08.224227 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9b0c49584d482ab5779cfd1a4a9968'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.231475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9b0c49584d482ab5779cfd1a4a9968'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.239837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9b0c49584d482ab5779cfd1a4a9968'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.252908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9b0c49584d482ab5779cfd1a4a9968'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.253634 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9b0c49584d482ab5779cfd1a4a9968'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.260197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1186/2390] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:08 2022] DELETE /identity/v3/users/3c9b0c49584d482ab5779cfd1a4a9968 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:08.265468 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.265880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.266264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.286200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:08.287443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:08.293188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:08.377278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1205/2391] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:08.378185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:08.381176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:08.443678 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a5e8b-f4c7-4e5f-884a-45b85321fe55 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:08.447356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:08.447959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.448236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.448509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.461101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:08.462528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f0ffc-8832-4300-b766-8759f0f66aa0 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:08.473030 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1187/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:08.775170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:08.776970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:08.792398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355ec32-5841-4f15-9189-0eb713860a28 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:08.797719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:08.798367 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.798651 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.798935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] PATH_INFO: `/v3/projects/0d8166ca7798414c9b8749180ba858cf` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.800113 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8166ca7798414c9b8749180ba858cf)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:08.803404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:08.855646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8166ca7798414c9b8749180ba858cf', 'request_id': 'req-535d85a1-29e5-4d3d-8d38-3b73098f4e15'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.861731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8166ca7798414c9b8749180ba858cf', 'request_id': 'req-535d85a1-29e5-4d3d-8d38-3b73098f4e15'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.868083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8166ca7798414c9b8749180ba858cf', 'request_id': 'req-535d85a1-29e5-4d3d-8d38-3b73098f4e15'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.879907 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] The token cache is being invalidate because project 0d8166ca7798414c9b8749180ba858cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:08.880194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.880808 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-535d85a1-29e5-4d3d-8d38-3b73098f4e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:08.882494 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1206/2393] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:08 2022] DELETE /identity/v3/projects/0d8166ca7798414c9b8749180ba858cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:08.887374 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.887849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.887962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:08.908962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:08.910157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:08.923460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:08.973092 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1188/2394] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:08.981912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:08.982194 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:08.982500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.003010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:09.004253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:09.012595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1207/2395] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:09.017493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.027345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f7dea-ca16-423f-ae55-9f8f7e31dab2 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.032403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.033008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.033318 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.033596 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.034249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:09.034552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.036175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.049821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1189/2396] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:09.054289 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.065964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58f75-a4c7-465f-b0e9-16d5577eb8a2 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.070702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.071349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.071630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.071904 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.072549 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.074428 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.106169 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1208/2397] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:09.107542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.117699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba461-1e0b-464e-8b67-a39fb9f81a18 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.174031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.174632 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.174909 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.175210 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.175829 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.177724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.198628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1190/2398] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:09.202809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.213564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2cdb-0e44-404c-aad7-b3579b1c3545 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.218127 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.218745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.219026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.219336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.219971 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.221552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.231592 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1209/2399] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:09.235337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.244991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960071d7-b6f9-4423-bccd-d2f2bf7b18b0 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.250494 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.251106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.251390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.251694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.252326 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.253900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f9fc4-ab26-42c9-9624-8bbb489fe583 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.264592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1191/2400] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:09.269219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.278902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab868-74da-4c5c-9e85-5f14b729d9d6 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.284377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.285102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.285404 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.285685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] PATH_INFO: `/v3/projects/fc4b589009814d04872c93a6cac0ad50/users/5ade270fb13a448eb3bc119dc1333f21/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.302440 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4b589009814d04872c93a6cac0ad50, user_id=5ade270fb13a448eb3bc119dc1333f21, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.305337 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.318708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1210/2401] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:09 2022] PUT /identity/v3/projects/fc4b589009814d04872c93a6cac0ad50/users/5ade270fb13a448eb3bc119dc1333f21/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:09.329095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.329492 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.329777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.358688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] MFA Rules not processed for user `5ade270fb13a448eb3bc119dc1333f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:09.360470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:09.430158 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1192/2402] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:09.434663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.472995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:09.505872 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49edab-a352-4263-beb2-87cdc165e7b7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.510587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.523394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.523394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.523394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.523394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.523394 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.551703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1211/2403] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:09.555734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.567542 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57b02-2ae4-4ec9-a447-f11af51efd6f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.579392 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:09.582997 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.584710 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:09.629114 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.629728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.630014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.630283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.630911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.632912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.647362 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ad186-949e-45d3-b487-3c3d742ad279 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.654702 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1193/2404] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:09.654835 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.656540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.656833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.657111 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.658944 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.660019 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:09.670010 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21152d6-5463-4322-8fb7-41ec358321b8 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.676790 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.677614 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.677783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.678059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.678719 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.680316 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.691347 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1194/2405] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:09.695057 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.708676 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a82ef-5c22-485b-95c3-e3f12eadebe2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.714050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.714629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.714902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.715202 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] PATH_INFO: `/v3/projects/afa0815bb5a1477b98dd196c2edd54ee/users/7db20783e8d9461aab35b6f5b6d4a1c9/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.732101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.733560 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.737104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa0815bb5a1477b98dd196c2edd54ee, user_id=7db20783e8d9461aab35b6f5b6d4a1c9, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.740225 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.744349 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1212/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:09.762430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1195/2407] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:09 2022] PUT /identity/v3/projects/afa0815bb5a1477b98dd196c2edd54ee/users/7db20783e8d9461aab35b6f5b6d4a1c9/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:09.766584 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.778336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892f0b-144f-41d5-8f0a-229d5519d83a service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.847765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.848451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.848889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.849168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.850241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.851764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57136b61-0c71-4d60-9901-a8ed852df189 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.865684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1213/2408] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:09.867696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:09.879182 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533faa-5372-4300-a4b4-c051cb559c2c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:09.884099 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:09.884760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.885036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.885306 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] PATH_INFO: `/v3/projects/afa0815bb5a1477b98dd196c2edd54ee/users/7db20783e8d9461aab35b6f5b6d4a1c9/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.887344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa0815bb5a1477b98dd196c2edd54ee, user_id=7db20783e8d9461aab35b6f5b6d4a1c9, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:09.889976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:09.900527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1196/2409] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:09 2022] PUT /identity/v3/projects/afa0815bb5a1477b98dd196c2edd54ee/users/7db20783e8d9461aab35b6f5b6d4a1c9/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:09.912464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:09.912749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:09.913025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:09.929443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:09.945212 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] MFA Rules not processed for user `7db20783e8d9461aab35b6f5b6d4a1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:09.946491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:10.022232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1214/2410] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:10.035009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:10.036759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:10.099633 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bafee0-e142-4c5d-8797-7e2ebea40068 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:10.103566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:10.104281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:10.104602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:10.104906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:10.114386 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:10.115846 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:10.125314 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1197/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:10.314858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:10.324653 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c35df7-6cf5-4539-9ebe-2e93dd2160a3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:10.328896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:10.329491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:10.329767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:10.330032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:10.331747 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:10.401273 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:10.402740 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aa624-213e-4045-bed5-f1070d908a3e service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:10.412944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1215/2412] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:11.501222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:11.573831 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc83a3-c7b4-4208-ae67-46776e4d6cc9 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:11.580138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:11.580777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:11.581055 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:11.581322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] PATH_INFO: `/v3/users/5ade270fb13a448eb3bc119dc1333f21` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:11.582433 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ade270fb13a448eb3bc119dc1333f21)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:11.584365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:11.585972 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:11.636695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ade270fb13a448eb3bc119dc1333f21'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:11.645895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ade270fb13a448eb3bc119dc1333f21'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:11.657739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ade270fb13a448eb3bc119dc1333f21'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:11.672185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ade270fb13a448eb3bc119dc1333f21'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:11.673001 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ade270fb13a448eb3bc119dc1333f21'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:11.679503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1198/2413] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:11 2022] DELETE /identity/v3/users/5ade270fb13a448eb3bc119dc1333f21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:11.684183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:11.684696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:11.684816 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:11.704812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:11.706025 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:11.772912 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1216/2414] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:11.796666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:11.796666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:11.872287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e1952-7755-428d-9b4c-a6548a45ef89 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:11.876236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:11.876837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:11.877109 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:11.877376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:11.888242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:11.890716 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97687a7-fc7d-4ea2-b506-1f68035e59ce service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:11.901444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1199/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:11.958117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:11.959557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:11.973833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e71c-b358-438d-883d-31e5fb0568dd None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:11.978525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:11.979222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:11.979505 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:11.979781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] PATH_INFO: `/v3/users/2d2e157bbcd94cc28e034aa61339efaa` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:11.980916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2e157bbcd94cc28e034aa61339efaa)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:11.982828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.005811 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:12.032706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2e157bbcd94cc28e034aa61339efaa'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.033607 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2e157bbcd94cc28e034aa61339efaa'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.040701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2e157bbcd94cc28e034aa61339efaa'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.054771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2e157bbcd94cc28e034aa61339efaa'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.062839 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2e157bbcd94cc28e034aa61339efaa'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.069562 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1217/2416] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:11 2022] DELETE /identity/v3/users/2d2e157bbcd94cc28e034aa61339efaa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:12.074691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.075002 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.075588 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.097994 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:12.099218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.177699 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1200/2417] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:12.187761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.189183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.247295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca288d-57f4-439a-954d-487b454914fc admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.251057 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.251693 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.251973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.252247 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.262260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.263797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.275266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1218/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:12.277340 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.278748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.292196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ff12b-2685-4bf0-8372-eee07b694b3d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.299557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.300313 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.300662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.301006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] PATH_INFO: `/v3/projects/fc4b589009814d04872c93a6cac0ad50` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.302236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4b589009814d04872c93a6cac0ad50)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.304364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.323911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:12.357945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4b589009814d04872c93a6cac0ad50', 'request_id': 'req-547cf523-4cc4-45dc-a738-fdc8546d8564'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.365323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4b589009814d04872c93a6cac0ad50', 'request_id': 'req-547cf523-4cc4-45dc-a738-fdc8546d8564'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.372232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4b589009814d04872c93a6cac0ad50', 'request_id': 'req-547cf523-4cc4-45dc-a738-fdc8546d8564'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.383982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] The token cache is being invalidate because project fc4b589009814d04872c93a6cac0ad50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:12.384272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.384942 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.386464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1201/2419] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:12 2022] DELETE /identity/v3/projects/fc4b589009814d04872c93a6cac0ad50 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:12.391141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.401200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70aeb0-c023-4efb-a90f-59a4ed309f55 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.462540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.463354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.463703 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.464046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] PATH_INFO: `/v3/users/7db20783e8d9461aab35b6f5b6d4a1c9` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.465286 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db20783e8d9461aab35b6f5b6d4a1c9)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.467344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.515732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:12.523684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db20783e8d9461aab35b6f5b6d4a1c9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.525122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db20783e8d9461aab35b6f5b6d4a1c9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.532779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db20783e8d9461aab35b6f5b6d4a1c9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.548873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db20783e8d9461aab35b6f5b6d4a1c9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.551027 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.552532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.563803 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db20783e8d9461aab35b6f5b6d4a1c9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.565950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cf523-4cc4-45dc-a738-fdc8546d8564 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.570472 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1219/2420] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:12 2022] DELETE /identity/v3/users/7db20783e8d9461aab35b6f5b6d4a1c9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:12.571475 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.572129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.572403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.572670 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] PATH_INFO: `/v3/projects/3820bc0b2d6947feab305575e6948bcb` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.573902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3820bc0b2d6947feab305575e6948bcb)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.575918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.628877 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3820bc0b2d6947feab305575e6948bcb', 'request_id': 'req-7d40423b-a651-44b1-996b-9d37f86ebd46'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.636629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3820bc0b2d6947feab305575e6948bcb', 'request_id': 'req-7d40423b-a651-44b1-996b-9d37f86ebd46'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.642918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3820bc0b2d6947feab305575e6948bcb', 'request_id': 'req-7d40423b-a651-44b1-996b-9d37f86ebd46'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.656602 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] The token cache is being invalidate because project 3820bc0b2d6947feab305575e6948bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:12.656918 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.657601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.659130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1202/2421] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:12 2022] DELETE /identity/v3/projects/3820bc0b2d6947feab305575e6948bcb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:12.662994 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.664520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.733451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360ac6-1883-4199-8e3f-f6245b5277d1 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.792867 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.793502 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.793779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.794050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] PATH_INFO: `/v3/users/9452ee7991594bdf9db900a2d28ffaf1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.795201 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9452ee7991594bdf9db900a2d28ffaf1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.797630 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.848445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9452ee7991594bdf9db900a2d28ffaf1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.849124 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9452ee7991594bdf9db900a2d28ffaf1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.857144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9452ee7991594bdf9db900a2d28ffaf1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.861646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:12.863121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:12.879349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40423b-a651-44b1-996b-9d37f86ebd46 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:12.880336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:12.881974 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9452ee7991594bdf9db900a2d28ffaf1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.885125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:12.885828 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.886129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.886383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] PATH_INFO: `/v3/projects/afa0815bb5a1477b98dd196c2edd54ee` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:12.887624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa0815bb5a1477b98dd196c2edd54ee)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:12.889613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:12.902400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-eeda2c3b-dc7c-47f8-af5a-32979e3d920d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9452ee7991594bdf9db900a2d28ffaf1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.910152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1220/2422] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:12 2022] DELETE /identity/v3/users/9452ee7991594bdf9db900a2d28ffaf1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:12.948891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa0815bb5a1477b98dd196c2edd54ee', 'request_id': 'req-3d1266ea-5706-444c-93ed-490545d6ac9b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.957956 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa0815bb5a1477b98dd196c2edd54ee', 'request_id': 'req-3d1266ea-5706-444c-93ed-490545d6ac9b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.964622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa0815bb5a1477b98dd196c2edd54ee', 'request_id': 'req-3d1266ea-5706-444c-93ed-490545d6ac9b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.983667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] The token cache is being invalidate because project afa0815bb5a1477b98dd196c2edd54ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:12.983667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.983667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3d1266ea-5706-444c-93ed-490545d6ac9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:12.983667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1203/2423] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:12 2022] DELETE /identity/v3/projects/afa0815bb5a1477b98dd196c2edd54ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:12.988786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:12.989342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:12.990056 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.017869 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.019511 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.094137 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1221/2424] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:13.102237 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.103681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.104028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.129115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.129115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.135684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1204/2425] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:13.139782 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.150048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d231-5704-4348-83e9-bd9f466b6d2b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.155419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.155826 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.156102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.156373 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.157018 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:13.157481 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.159049 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.172853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1222/2426] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:13.187783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.187783 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:13.194875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374672-a050-4bf5-bd74-3382b6ff95fc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.202703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.203365 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.203722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.204613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.205396 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.207875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.216850 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.218594 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.243649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd549a-2c4a-491b-a918-113a02a904ae admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.248986 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1205/2427] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:13.254311 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.254534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.255772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.256055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.256361 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] PATH_INFO: `/v3/projects/8ce51af4f53a461589f1ca3f345850f3` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.257517 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce51af4f53a461589f1ca3f345850f3)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.259598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.320306 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce51af4f53a461589f1ca3f345850f3', 'request_id': 'req-22cbda55-fb67-4167-afcd-3772cbe19cdd'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:13.327027 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce51af4f53a461589f1ca3f345850f3', 'request_id': 'req-22cbda55-fb67-4167-afcd-3772cbe19cdd'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:13.333292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f0dfb-4afd-41cd-88ec-db96e41e93aa admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.349400 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce51af4f53a461589f1ca3f345850f3', 'request_id': 'req-22cbda55-fb67-4167-afcd-3772cbe19cdd'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:13.364757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] The token cache is being invalidate because project 8ce51af4f53a461589f1ca3f345850f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:13.365052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:13.365683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-22cbda55-fb67-4167-afcd-3772cbe19cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:13.367384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1223/2428] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:13 2022] DELETE /identity/v3/projects/8ce51af4f53a461589f1ca3f345850f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:13.373884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27153-ef16-421c-a82b-17d584201882 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.374333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27153-ef16-421c-a82b-17d584201882 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.375203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27153-ef16-421c-a82b-17d584201882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.392517 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.393053 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.393384 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.393652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.394278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.396073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-60f27153-ef16-421c-a82b-17d584201882 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.396354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.397266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-60f27153-ef16-421c-a82b-17d584201882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.406571 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1224/2429] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:13.417455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.417923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.418333 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.420190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1206/2430] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:13.425157 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.426875 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.438821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226dc9-ce96-49c6-bff5-6be402864c2b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.440744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.441978 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.444360 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.445133 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.445434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.445722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.446495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.448138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.451062 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1225/2431] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:13.455219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.461984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1207/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:13.463285 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.464487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4226a-dd02-4e59-bc1a-c51dfeec2299 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.471253 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.471823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.472154 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.472434 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.473122 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:13.473445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.474069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66d12-f980-4129-86e9-8fc89a195aad admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.475067 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.480484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.481245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.481526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.481816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.482555 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.484921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.487909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1226/2433] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:13.492417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.503425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1208/2434] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:13.503606 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120e67c-963a-480b-9c7f-05c4e1962f35 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.504777 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.507781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.508378 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.508656 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.508926 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.509552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.511487 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.514843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105e21-14ba-4259-883b-58a18e43d52f admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.524943 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.525987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.526398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.526580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] PATH_INFO: `/v3/projects/a118e4fbeee34873ba5ef83689a514b0/users/6df78538b6c54fc3a970be0b9281973e/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.543906 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a118e4fbeee34873ba5ef83689a514b0, user_id=6df78538b6c54fc3a970be0b9281973e, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.544370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1227/2435] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:13.547607 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eaf52-1498-4dff-b2bf-6cb83523eb7f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.549328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.559223 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:13.560381 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1209/2436] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:13 2022] PUT /identity/v3/projects/a118e4fbeee34873ba5ef83689a514b0/users/6df78538b6c54fc3a970be0b9281973e/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:13.570913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.571238 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.571512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.599397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] MFA Rules not processed for user `6df78538b6c54fc3a970be0b9281973e`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.600681 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:13.614221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a35c5-20a5-495e-aceb-c6177414ecc7 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.620896 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:13.666245 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1210/2437] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:13.670820 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.674096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.674706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.674982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.675297 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.675932 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.677853 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.681974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88e83-295b-47a3-857e-d7a41f66a27d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.686558 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.687218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.687497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.687768 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.688401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.690287 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.702866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1228/2438] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:13.704010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.714702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3159-df31-4350-8783-8c4d81bc08a4 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.721921 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1211/2439] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:13.722075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.722075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.722075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.722075 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.722402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.722976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.723512 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.738119 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1229/2440] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:13.739775 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.751270 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216cec9-b7cd-4052-bc3b-6f79cb1d9429 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.785666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d67549-2521-4877-88ed-f20ba7ebf862 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.790540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.791342 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.791617 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.791884 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.792624 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.794529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.808395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.808993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.809269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.809548 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.810193 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.811832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.816666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1212/2441] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:13.828044 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1230/2442] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:13.828243 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.829046 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.836139 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60cab9-2131-4bce-82a0-6244125481c9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.838702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56417f2-4055-4a2a-be33-7fbb18b97e74 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.841121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.841753 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.841995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.842271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.842911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.843335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.843993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.844265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.844582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.844691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] PATH_INFO: `/v3/projects/dd53dcafeebd4015a0ba857c03611b74/users/b2e1ffdfa9fa4323b6ddf1f2dd80dcc9/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.854715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1213/2443] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:13.858725 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.863452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd53dcafeebd4015a0ba857c03611b74, user_id=b2e1ffdfa9fa4323b6ddf1f2dd80dcc9, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.866089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.869251 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014586af-219f-4853-9715-d13a57fbf69d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.874252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:13.875503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.875780 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.876048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] PATH_INFO: `/v3/projects/27c711ad390a43609a5e21ab4cedd160/users/aa9b10cb2bf646e59340ba132b7f7ef6/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.880102 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1231/2444] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:13 2022] PUT /identity/v3/projects/dd53dcafeebd4015a0ba857c03611b74/users/b2e1ffdfa9fa4323b6ddf1f2dd80dcc9/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:13.891108 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c711ad390a43609a5e21ab4cedd160, user_id=aa9b10cb2bf646e59340ba132b7f7ef6, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:13.893929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ffd3-c619-48e5-81ac-1e4c1a20e0c9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:13.908449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1214/2445] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:13 2022] PUT /identity/v3/projects/27c711ad390a43609a5e21ab4cedd160/users/aa9b10cb2bf646e59340ba132b7f7ef6/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:13.912598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:13.923346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:13.948730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:13.949393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:13.949393 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:13.979808 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] MFA Rules not processed for user `b2e1ffdfa9fa4323b6ddf1f2dd80dcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:13.980908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d39b0c-55b0-4721-a7fe-813cad2ef91a admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:13.981023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.025715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:14.037098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.037711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.037993 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.038266 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.038902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.040519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.049111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1215/2446] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:14.053995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1232/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:14.054941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.061078 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.063435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.066105 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1dab-694b-4b28-ae0c-ec1116962adc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.070687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.071351 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.071628 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.071899 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] PATH_INFO: `/v3/projects/27c711ad390a43609a5e21ab4cedd160/users/aa9b10cb2bf646e59340ba132b7f7ef6/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.073830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c711ad390a43609a5e21ab4cedd160, user_id=aa9b10cb2bf646e59340ba132b7f7ef6, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.076493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecf30c-9d9e-48df-b07c-e6333189467f admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.087006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1216/2448] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:14 2022] PUT /identity/v3/projects/27c711ad390a43609a5e21ab4cedd160/users/aa9b10cb2bf646e59340ba132b7f7ef6/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:14.098457 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.098903 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.099222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.121412 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629eaf0-8db9-4322-b776-82d6013c9282 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.128191 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] MFA Rules not processed for user `aa9b10cb2bf646e59340ba132b7f7ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:14.129390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.170824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.172034 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.172314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.172595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.191188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:14.201667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1217/2449] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:14.213423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.214890 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.228444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c380f-6848-4894-bdae-ebc7be3aad85 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.232403 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.232579 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.233013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.233294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.233566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.234610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.243421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1233/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:14.243572 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.246677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.256595 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1218/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:14.323198 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.399384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071885df-5995-4d45-be06-2d255e1dc2fd service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.404366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.404759 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.405083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.405445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] PATH_INFO: `/v3/users/6df78538b6c54fc3a970be0b9281973e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.406638 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df78538b6c54fc3a970be0b9281973e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.408763 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.438807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.440708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.457610 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4a3a-50c7-4f90-a177-c017e16f2522 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.464565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.465361 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.465782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.466541 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] PATH_INFO: `/v3/users/4a65b41189ad4647919646bd99a6c20e` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.468023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a65b41189ad4647919646bd99a6c20e)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.470568 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.487116 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df78538b6c54fc3a970be0b9281973e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.487875 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df78538b6c54fc3a970be0b9281973e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.501980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df78538b6c54fc3a970be0b9281973e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.521077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df78538b6c54fc3a970be0b9281973e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.547013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38f50c12-9d55-40be-b9b3-676a6e63f77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df78538b6c54fc3a970be0b9281973e'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.554637 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1234/2452] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:14 2022] DELETE /identity/v3/users/6df78538b6c54fc3a970be0b9281973e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:14.560789 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.561146 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.561456 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.576529 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a65b41189ad4647919646bd99a6c20e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.585891 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:14.587389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a65b41189ad4647919646bd99a6c20e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.587600 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.597721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a65b41189ad4647919646bd99a6c20e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.617717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a65b41189ad4647919646bd99a6c20e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.619031 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-5f18eb62-848e-4fb7-b95a-ec9bc4c41ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a65b41189ad4647919646bd99a6c20e'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:14.627976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1219/2453] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:14 2022] DELETE /identity/v3/users/4a65b41189ad4647919646bd99a6c20e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:14.634009 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.634419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.634709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.636426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:14.669095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:14.670694 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.681969 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:14.694663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1235/2454] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:14.706712 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.708518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.744262 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1220/2455] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:14.754690 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:14.756509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:14.786233 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f313f-318f-4f1e-9ebb-3c68ffd1fc84 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.818989 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41bc5a-93be-4261-969d-fb4dfc6e5061 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:14.822773 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.823675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.823858 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.824130 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.835543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.836974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.839810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:14.840420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:14.840706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:14.840973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:14.846546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1221/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:14.850525 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:14.852209 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:14.863453 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1236/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:15.148609 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.150474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.164680 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.166178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.170048 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd688e8-6c17-4c49-9add-fb20d1eb9403 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.177254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.178267 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.178557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.179540 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] PATH_INFO: `/v3/projects/d5f395beec6248288b902b678878a141` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.181528 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f395beec6248288b902b678878a141)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.182397 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8faf-78a8-48e4-bacb-b8a293c178d9 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.183662 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.188631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.189384 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.189764 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.190133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] PATH_INFO: `/v3/projects/a118e4fbeee34873ba5ef83689a514b0` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.191417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a118e4fbeee34873ba5ef83689a514b0)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.194307 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.238848 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f395beec6248288b902b678878a141', 'request_id': 'req-42bf7893-b017-4a2c-9d47-9caf09844513'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.246335 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a118e4fbeee34873ba5ef83689a514b0', 'request_id': 'req-a4a53f2a-8414-476b-b227-b0c3613822ee'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.246591 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f395beec6248288b902b678878a141', 'request_id': 'req-42bf7893-b017-4a2c-9d47-9caf09844513'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.252851 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a118e4fbeee34873ba5ef83689a514b0', 'request_id': 'req-a4a53f2a-8414-476b-b227-b0c3613822ee'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.253412 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f395beec6248288b902b678878a141', 'request_id': 'req-42bf7893-b017-4a2c-9d47-9caf09844513'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.259687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a118e4fbeee34873ba5ef83689a514b0', 'request_id': 'req-a4a53f2a-8414-476b-b227-b0c3613822ee'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.266179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] The token cache is being invalidate because project d5f395beec6248288b902b678878a141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:15.266464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.267218 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.268873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1222/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/projects/d5f395beec6248288b902b678878a141 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:15.272764 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.274095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.274244 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] The token cache is being invalidate because project a118e4fbeee34873ba5ef83689a514b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:15.274454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.275101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.276559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1237/2459] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/projects/a118e4fbeee34873ba5ef83689a514b0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:15.281006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.282614 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.310084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:15.322456 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:15.343103 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7893-b017-4a2c-9d47-9caf09844513 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.347758 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.348864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.349148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.349420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] PATH_INFO: `/v3/users/391a5807da2b47e1b14b511c8ace0cc8` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.350554 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391a5807da2b47e1b14b511c8ace0cc8)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.351806 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a53f2a-8414-476b-b227-b0c3613822ee admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.352526 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.356515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.357136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.357528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.357809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] PATH_INFO: `/v3/users/aa9b10cb2bf646e59340ba132b7f7ef6` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.359483 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9b10cb2bf646e59340ba132b7f7ef6)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.361402 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.401175 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391a5807da2b47e1b14b511c8ace0cc8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.408270 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391a5807da2b47e1b14b511c8ace0cc8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.410228 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9b10cb2bf646e59340ba132b7f7ef6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.411521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9b10cb2bf646e59340ba132b7f7ef6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.416793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391a5807da2b47e1b14b511c8ace0cc8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.419489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9b10cb2bf646e59340ba132b7f7ef6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.431173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391a5807da2b47e1b14b511c8ace0cc8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.431886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391a5807da2b47e1b14b511c8ace0cc8'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.432567 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9b10cb2bf646e59340ba132b7f7ef6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.437886 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1223/2460] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/users/391a5807da2b47e1b14b511c8ace0cc8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:15.439819 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9b10cb2bf646e59340ba132b7f7ef6'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.445731 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1238/2461] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/users/aa9b10cb2bf646e59340ba132b7f7ef6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:15.735684 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.737138 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.744283 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.746329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.840101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3953a-31c4-4894-9ccf-8117c017250c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.845380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.846156 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.846564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.846936 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] PATH_INFO: `/v3/projects/fe739b64469e47e69e6dd11f01729746` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.848176 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe739b64469e47e69e6dd11f01729746)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.850260 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9911e-2aa5-4f75-b64a-b88467516d19 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:15.850690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.855194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:15.855854 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.856132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.856405 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] PATH_INFO: `/v3/projects/27c711ad390a43609a5e21ab4cedd160` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.858966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c711ad390a43609a5e21ab4cedd160)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:15.861449 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:15.923245 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:15.933236 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c711ad390a43609a5e21ab4cedd160', 'request_id': 'req-409b2f86-07d4-4770-a720-0af05e8fd6ee'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.935706 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe739b64469e47e69e6dd11f01729746', 'request_id': 'req-30368717-1ea4-456e-bee6-8f6c969d25bc'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.941448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c711ad390a43609a5e21ab4cedd160', 'request_id': 'req-409b2f86-07d4-4770-a720-0af05e8fd6ee'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.943161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe739b64469e47e69e6dd11f01729746', 'request_id': 'req-30368717-1ea4-456e-bee6-8f6c969d25bc'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.946328 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:15.947683 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c711ad390a43609a5e21ab4cedd160', 'request_id': 'req-409b2f86-07d4-4770-a720-0af05e8fd6ee'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.949916 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe739b64469e47e69e6dd11f01729746', 'request_id': 'req-30368717-1ea4-456e-bee6-8f6c969d25bc'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.963308 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] The token cache is being invalidate because project fe739b64469e47e69e6dd11f01729746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:15.963708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.964258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] The token cache is being invalidate because project 27c711ad390a43609a5e21ab4cedd160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:15.964383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-30368717-1ea4-456e-bee6-8f6c969d25bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.964550 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.965185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:15.965899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1239/2462] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/projects/fe739b64469e47e69e6dd11f01729746 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:15.968967 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1224/2463] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/projects/27c711ad390a43609a5e21ab4cedd160 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:15.972025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:15.972479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec2e2-a75b-4514-b83a-a89760f068fd None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:15.972765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec2e2-a75b-4514-b83a-a89760f068fd None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:15.973043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec2e2-a75b-4514-b83a-a89760f068fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:15.973723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:15.992683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-d78ec2e2-a75b-4514-b83a-a89760f068fd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:15.993878 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-d78ec2e2-a75b-4514-b83a-a89760f068fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.039621 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b2f86-07d4-4770-a720-0af05e8fd6ee admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.044349 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.045014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.045266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.045806 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] PATH_INFO: `/v3/users/f924951328aa42d7ab1dcdc83c58ee40` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.047493 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f924951328aa42d7ab1dcdc83c58ee40)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.049388 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.059923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1240/2464] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:16.068973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.069629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.070278 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.095055 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:16.096309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.102895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f924951328aa42d7ab1dcdc83c58ee40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.104359 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1241/2465] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:16.108448 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.110765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f924951328aa42d7ab1dcdc83c58ee40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.118488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ecda9-3ea9-4590-84ca-e955a876a7af None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.118747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f924951328aa42d7ab1dcdc83c58ee40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.123889 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.125036 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.125329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.125585 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.126221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:16.126521 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.128123 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.132005 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f924951328aa42d7ab1dcdc83c58ee40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.132656 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f924951328aa42d7ab1dcdc83c58ee40'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.138712 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1225/2466] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:15 2022] DELETE /identity/v3/users/f924951328aa42d7ab1dcdc83c58ee40 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:16.140134 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1242/2467] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:16.144495 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.145935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.215286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e12e2-48f3-4f5d-b754-0715903885cc admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.220074 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.220685 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.220991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.221268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.221908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.223876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.240486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:16.256825 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1226/2468] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:16.258043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.268603 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86595e28-09ba-45c1-b4c9-c33dd7966d2e admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.330401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.331033 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.331329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.331602 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.332768 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.334676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.359765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1243/2469] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:16.363835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.375228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a0e1-e71e-4ea4-b921-ee9617fb5f59 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.380028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.380631 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.380910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.381301 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.381945 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.383580 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.394378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1227/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:16.398374 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.410010 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56153796-a124-4f10-9020-75a0934a4046 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.414866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.415520 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.415771 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.416090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.416730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.418304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.427888 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.429659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.437309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1244/2471] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:16.438488 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.446264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7462-552e-42b9-84c6-d5dcaa69c9d7 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.449343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0af9b9-83f3-4985-8e85-064b9fc52b68 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.451446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.452084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.453276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.453569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] PATH_INFO: `/v3/projects/d61c60853f4b4de9b44e19578e8f0b37` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.455323 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61c60853f4b4de9b44e19578e8f0b37)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.455475 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.456470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.456848 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.457188 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] PATH_INFO: `/v3/projects/27cdbd9b08294907930bdca08e7a5f38/users/f85024493ab1478c82caea85e8b0fcfd/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.457308 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.473788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cdbd9b08294907930bdca08e7a5f38, user_id=f85024493ab1478c82caea85e8b0fcfd, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.476478 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd69ef-b132-4002-b75c-aeb64db7bbfb admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.490750 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1245/2472] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:16 2022] PUT /identity/v3/projects/27cdbd9b08294907930bdca08e7a5f38/users/f85024493ab1478c82caea85e8b0fcfd/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:16.501455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.501744 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.502026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.511527 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61c60853f4b4de9b44e19578e8f0b37', 'request_id': 'req-f9b6b2fd-d789-4eee-848a-e696cfab3343'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.518719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:16.521920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61c60853f4b4de9b44e19578e8f0b37', 'request_id': 'req-f9b6b2fd-d789-4eee-848a-e696cfab3343'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.528911 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61c60853f4b4de9b44e19578e8f0b37', 'request_id': 'req-f9b6b2fd-d789-4eee-848a-e696cfab3343'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.537401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] MFA Rules not processed for user `f85024493ab1478c82caea85e8b0fcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:16.538658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.541214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] The token cache is being invalidate because project d61c60853f4b4de9b44e19578e8f0b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:16.541505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.542151 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-f9b6b2fd-d789-4eee-848a-e696cfab3343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:16.544045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1228/2473] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:16 2022] DELETE /identity/v3/projects/d61c60853f4b4de9b44e19578e8f0b37 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:16.549448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e872f-70e7-472e-9cd5-3077ef339605 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.549736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e872f-70e7-472e-9cd5-3077ef339605 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.550013 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e872f-70e7-472e-9cd5-3077ef339605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.569556 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6c9e872f-70e7-472e-9cd5-3077ef339605 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:16.570763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6c9e872f-70e7-472e-9cd5-3077ef339605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.609619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1246/2474] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:16.613623 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.614928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.630532 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1229/2475] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:16.638354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.638636 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.638908 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.658737 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:16.659982 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:16.668136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1230/2476] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:16.672980 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.681629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d99ac-5434-4206-a6f8-b6a91ecd73de None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.681805 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2ef97-859c-4438-bff5-f352478421c9 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.686279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.686423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.686885 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.687204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.687310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.687480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.687593 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.687812 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.688117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:16.688419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.688518 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.689985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.690380 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.701851 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1231/2477] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:16.706088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.716184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5859-5ff4-4637-b2a1-aed050901201 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.719314 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1247/2478] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:16.723346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.724552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.725215 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.725434 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.725707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.726336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.728269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.760338 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1232/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:16.762075 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.786953 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bccc-0a13-4244-b196-624d23164743 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.796912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:16.813870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:16.834496 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832c63d-8bbf-4f55-98ba-bb1fc9333ca3 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.839401 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.840194 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.840548 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.840883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.841598 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.844738 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.851510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.852218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.852608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.853017 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.853820 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.855860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.867582 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1233/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:16.871640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.879109 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1248/2481] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:16 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:16.881649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.884132 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5259a-3e23-4c19-94c4-934113253328 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.888770 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.889368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.889650 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.890444 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.891120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.891761 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d99592-32ca-477b-84f0-eac2a9692f9d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.892697 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.896942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.897531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.897809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.898084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.898716 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.900301 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.903353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1234/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:16.907682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.914050 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1249/2483] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:16.915241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.917522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1dd9a-da1e-46b7-a4cd-aa966cc9eee9 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.922482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.923125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.923546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.923824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.924453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.924992 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ebab-0360-4b7f-a7d9-0abbc69064c2 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.926023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.929580 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.930210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.930492 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.930767 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] PATH_INFO: `/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff/users/c08358aaa79949769fc1714a46698c41/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.937022 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1235/2484] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:16.940919 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.949849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fae9fffbb384c9fb7676e3a9fedecff, user_id=c08358aaa79949769fc1714a46698c41, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.950950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114589-e13a-4c54-96dd-63b093a7ce1d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:16.953281 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.956524 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:16.957174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:16.957446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:16.957714 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] PATH_INFO: `/v3/projects/260a9329c3bc45bfa6127145e86749b1/users/93589cdeda8b40629edf0071784f86eb/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:16.969608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1250/2485] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:16 2022] PUT /identity/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff/users/c08358aaa79949769fc1714a46698c41/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:16.974243 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:16.978779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260a9329c3bc45bfa6127145e86749b1, user_id=93589cdeda8b40629edf0071784f86eb, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:16.981497 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473740c-f4b5-486a-be83-b34b35cb0fa4 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:16.996214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1236/2486] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:16 2022] PUT /identity/v3/projects/260a9329c3bc45bfa6127145e86749b1/users/93589cdeda8b40629edf0071784f86eb/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:17.008417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.008821 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.009824 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.038189 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] MFA Rules not processed for user `93589cdeda8b40629edf0071784f86eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:17.039461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:17.047786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a053e-39e1-4281-9b0d-b45c70545495 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:17.109779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:17.110395 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.110674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.110951 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.111628 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:17.117093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1237/2487] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:17.117303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:17.126389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:17.128131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:17.139967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1251/2488] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:17.141770 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:17.154924 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e100-2305-4ad6-99c3-6179ab81d019 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:17.159445 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:17.160117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.160396 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.160697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] PATH_INFO: `/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff/users/c08358aaa79949769fc1714a46698c41/roles/55e94c99a5d74674bcc214e7a019295d` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.162601 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fae9fffbb384c9fb7676e3a9fedecff, user_id=c08358aaa79949769fc1714a46698c41, role_id=55e94c99a5d74674bcc214e7a019295d)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:17.165312 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7b92e-0b19-4a82-aca2-d2e39df38112 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:17.176942 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1252/2489] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:17 2022] PUT /identity/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff/users/c08358aaa79949769fc1714a46698c41/roles/55e94c99a5d74674bcc214e7a019295d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:17.188343 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fec80-af97-45f1-9720-63373426101c None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.188631 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fec80-af97-45f1-9720-63373426101c None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.188902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fec80-af97-45f1-9720-63373426101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.196173 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a09ddb-d58e-4713-8ae5-c613936e6f67 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:17.207962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:17.214627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:17.220150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9c6fec80-af97-45f1-9720-63373426101c None None] MFA Rules not processed for user `c08358aaa79949769fc1714a46698c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:17.222064 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9c6fec80-af97-45f1-9720-63373426101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:17.251474 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb59ec19c77483b9f6bea59189b22a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:17.252222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.252508 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.252814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.297103 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1253/2490] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:17.309329 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fec80-af97-45f1-9720-63373426101c None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:17.310975 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9c6fec80-af97-45f1-9720-63373426101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:17.313500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:17.315023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:17.325446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1238/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:17.375721 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fec80-af97-45f1-9720-63373426101c None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:17.379679 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:17.380303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:17.380590 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:17.380866 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:17.391224 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:17.392690 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead656d3-2bd2-477d-aabc-951989801ffd service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:17.402728 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1254/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:17.963722 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:18.026640 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79689d81-4519-4516-94c8-3d26db101172 service glance] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:18.031688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:18.032312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:18.032592 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:18.032864 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] PATH_INFO: `/v3/users/f85024493ab1478c82caea85e8b0fcfd` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:18.033971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85024493ab1478c82caea85e8b0fcfd)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:18.035905 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:18.082850 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85024493ab1478c82caea85e8b0fcfd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.089985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85024493ab1478c82caea85e8b0fcfd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.097168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85024493ab1478c82caea85e8b0fcfd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.104587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:18.111571 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85024493ab1478c82caea85e8b0fcfd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.112611 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85024493ab1478c82caea85e8b0fcfd'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.119015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1239/2493] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:17 2022] DELETE /identity/v3/users/f85024493ab1478c82caea85e8b0fcfd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:18.123791 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:18.124237 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:18.124363 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:18.144923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:18.146195 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:18.210824 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1255/2494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:18.221509 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:18.223025 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:18.291849 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff76d7-83c4-4cd4-89db-7b64d4e761b7 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:18.295920 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:18.297067 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:18.297354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:18.297626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:18.306984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:18.308574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:18.318929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1240/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:18.587339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:18.588828 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:18.601219 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463722-2917-4adb-a242-c9d4443e1199 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:18.605888 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:18.606524 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:18.607165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:18.607165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] PATH_INFO: `/v3/projects/27cdbd9b08294907930bdca08e7a5f38` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:18.608470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cdbd9b08294907930bdca08e7a5f38)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:18.610939 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:18.650737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:18.661411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cdbd9b08294907930bdca08e7a5f38', 'request_id': 'req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.667096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cdbd9b08294907930bdca08e7a5f38', 'request_id': 'req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.674660 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cdbd9b08294907930bdca08e7a5f38', 'request_id': 'req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.687150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] The token cache is being invalidate because project 27cdbd9b08294907930bdca08e7a5f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:18.687442 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.688066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.689597 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1256/2496] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:18 2022] DELETE /identity/v3/projects/27cdbd9b08294907930bdca08e7a5f38 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:18.693665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:18.703254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00c74-423a-4a21-8cd9-75f4df5f159e service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:18.763467 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:18.764093 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:18.764372 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:18.764646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] PATH_INFO: `/v3/users/c08358aaa79949769fc1714a46698c41` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:18.765800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08358aaa79949769fc1714a46698c41)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:18.767847 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:18.826811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08358aaa79949769fc1714a46698c41'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.833968 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08358aaa79949769fc1714a46698c41'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.852096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08358aaa79949769fc1714a46698c41'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.868154 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08358aaa79949769fc1714a46698c41'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.868860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-cd602796-90fe-4ae7-988a-089f8929037b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08358aaa79949769fc1714a46698c41'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:18.874720 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1241/2497] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:18 2022] DELETE /identity/v3/users/c08358aaa79949769fc1714a46698c41 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:19.162995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.165411 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:19.179958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0ad1-2301-4f21-9dcc-f46f32c01bb9 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.237051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.237615 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.237890 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.238159 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] PATH_INFO: `/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.239303 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fae9fffbb384c9fb7676e3a9fedecff)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.241210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.288737 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fae9fffbb384c9fb7676e3a9fedecff', 'request_id': 'req-f12bce1f-1637-4262-90b3-0e9b13158f63'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:19.294151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fae9fffbb384c9fb7676e3a9fedecff', 'request_id': 'req-f12bce1f-1637-4262-90b3-0e9b13158f63'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:19.301250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fae9fffbb384c9fb7676e3a9fedecff', 'request_id': 'req-f12bce1f-1637-4262-90b3-0e9b13158f63'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:19.313788 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] The token cache is being invalidate because project 7fae9fffbb384c9fb7676e3a9fedecff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:19.314073 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:19.314684 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-f12bce1f-1637-4262-90b3-0e9b13158f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:19.316170 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1257/2498] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:19 2022] DELETE /identity/v3/projects/7fae9fffbb384c9fb7676e3a9fedecff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:19.321110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.321577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.321741 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.345234 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:19.346460 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:19.352014 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:19.416376 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1242/2499] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:19.424780 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.425069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.427292 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.448852 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:19.450058 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:19.458736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1258/2500] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:19.463264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.477545 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45201da9-7f7a-4942-90a9-a1a4ba8fdbfd None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.482162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.482798 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.483214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.483488 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.484128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:19.484428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.485999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.497771 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1243/2501] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:15:19.502671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.511934 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a998c-c543-4c8f-88a1-cbdfa7f52eeb None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.522443 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.523284 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.523559 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.523832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.524479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.526370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.560345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1259/2502] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:19 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:19.562344 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.572535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15fa53-0291-438e-b3ca-c7a0affda93d admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.634096 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.634709 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.634974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.635397 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.635964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.637893 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.663056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1244/2503] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:19 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:19.664408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.677910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42442375-12ce-4025-869e-9c3b1ed63942 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.684784 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.685150 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.685429 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.685702 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.686342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.688471 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.700991 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1260/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:19.705389 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.716769 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3d4b-2890-460e-bcbe-78fd64d0a37a admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.723557 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.724136 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.724415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.724708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.725331 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.726936 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f0032-1ca2-4d7f-ad20-25c5eb3eafb3 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.741728 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1245/2505] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:19.743667 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.754738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80468a5-d0c2-4ac8-bac6-f333f3356673 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.759620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.760369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.760738 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.761158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] PATH_INFO: `/v3/projects/25d09baedc514065b1f477a8f920590c/users/f130a445c66741fe8315c4b33f69039a/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.774287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:19.778687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d09baedc514065b1f477a8f920590c, user_id=f130a445c66741fe8315c4b33f69039a, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.781963 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:19.796577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1261/2506] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:19 2022] PUT /identity/v3/projects/25d09baedc514065b1f477a8f920590c/users/f130a445c66741fe8315c4b33f69039a/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:19.808281 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.808565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.808838 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.836505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] MFA Rules not processed for user `f130a445c66741fe8315c4b33f69039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:19.837696 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:19.907407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1246/2507] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:19.917938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:19.919643 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:19.979152 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61695e9-2e79-4085-b494-d385f15bfdfd admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:19.984043 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:19.984649 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:19.984927 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:19.985197 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:19.994144 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:19.995540 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcaf2-f154-41b1-a214-28f58b559895 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:20.007029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1262/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:25.341799 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:25.350996 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:25.409379 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf4d4-4857-4aab-83fa-679cbce14407 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:25.413892 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:25.414511 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:25.414793 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:25.415062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] PATH_INFO: `/v3/users/f130a445c66741fe8315c4b33f69039a` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:25.416259 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f130a445c66741fe8315c4b33f69039a)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:25.418211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:25.465756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f130a445c66741fe8315c4b33f69039a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:25.473214 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f130a445c66741fe8315c4b33f69039a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:25.480174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f130a445c66741fe8315c4b33f69039a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:25.492675 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f130a445c66741fe8315c4b33f69039a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:25.493305 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f130a445c66741fe8315c4b33f69039a'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:25.499060 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1247/2509] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:25 2022] DELETE /identity/v3/users/f130a445c66741fe8315c4b33f69039a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:25.503646 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:25.504242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:25.504242 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:25.523369 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:25.524766 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:25.586470 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1263/2510] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:25.596629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:25.598020 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:25.656590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac9a1-4f95-430b-bf60-69a04733af91 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:25.660934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:25.661560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:25.661822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:25.662094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:25.671423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:25.672837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:25.682665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1248/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:25.957989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:25.959406 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:25.973265 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befee2d7-07e6-4149-8203-2827ad7d1cd1 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:25.980665 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:25.980842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:25.981438 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:25.981711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:25.981980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] PATH_INFO: `/v3/users/b2e1ffdfa9fa4323b6ddf1f2dd80dcc9` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:25.983115 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e1ffdfa9fa4323b6ddf1f2dd80dcc9)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:25.984428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:25.990261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.001566 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531e42-346e-4478-ac4d-366ca9d0c5aa service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.012370 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.013016 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.013294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.013565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] PATH_INFO: `/v3/projects/25d09baedc514065b1f477a8f920590c` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.015199 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d09baedc514065b1f477a8f920590c)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.024390 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.049640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e1ffdfa9fa4323b6ddf1f2dd80dcc9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.050413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e1ffdfa9fa4323b6ddf1f2dd80dcc9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.051394 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:26.062435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e1ffdfa9fa4323b6ddf1f2dd80dcc9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.078842 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e1ffdfa9fa4323b6ddf1f2dd80dcc9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.087519 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-05b0584d-7c52-44e1-88d2-99f284a407f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e1ffdfa9fa4323b6ddf1f2dd80dcc9'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.087837 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d09baedc514065b1f477a8f920590c', 'request_id': 'req-77ccf0a6-15cf-4ec3-b538-62b31494941d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.093931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1264/2512] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:25 2022] DELETE /identity/v3/users/b2e1ffdfa9fa4323b6ddf1f2dd80dcc9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:26.099168 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.099398 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.099672 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.100322 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d09baedc514065b1f477a8f920590c', 'request_id': 'req-77ccf0a6-15cf-4ec3-b538-62b31494941d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.106286 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d09baedc514065b1f477a8f920590c', 'request_id': 'req-77ccf0a6-15cf-4ec3-b538-62b31494941d'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.112894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:26.120753 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.123282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.123991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] The token cache is being invalidate because project 25d09baedc514065b1f477a8f920590c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:26.124297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.125122 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-77ccf0a6-15cf-4ec3-b538-62b31494941d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.127409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1249/2513] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:25 2022] DELETE /identity/v3/projects/25d09baedc514065b1f477a8f920590c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:26.132354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603010-cfe0-4222-b211-7e7a5fa981ff None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.132745 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603010-cfe0-4222-b211-7e7a5fa981ff None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.133117 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603010-cfe0-4222-b211-7e7a5fa981ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.154336 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-bb603010-cfe0-4222-b211-7e7a5fa981ff None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.155688 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-bb603010-cfe0-4222-b211-7e7a5fa981ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.190336 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1265/2514] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:26.201199 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.202694 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.231841 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1250/2515] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:26.240984 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.241266 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.241537 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.267601 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.269477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660fbd1-bd67-4fe0-8137-83c3d64192ab None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.269635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.273126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.273793 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.274072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.274342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.278235 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1251/2516] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:26.282258 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.285370 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.286779 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.292693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ab0b4-8cb7-4ef8-9868-90e3284c5bfe None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.296724 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1266/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:26.297700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.298916 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.299219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.299498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.300129 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:26.300427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.302011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.314253 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1252/2518] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:26.318048 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.327683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05c54-234d-4b5c-a40d-6da5e17005ff service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.332447 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.333069 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.333455 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.333618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.334321 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.336351 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.374452 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1267/2519] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:26.378427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.388409 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472a62c-b7a7-4785-867f-77392afb049b admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.449839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.450519 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.450933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.451295 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.451971 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.453950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.476296 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1253/2520] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:15:26.480451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.497881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a7e0-c448-44d7-a7be-af7f7f658b06 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.503182 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.503790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.504325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.504325 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.504956 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.506536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.517640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1268/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:26.521695 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.534373 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91d010-a4a4-4bb4-b164-d4906b55b53c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.540252 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.540863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.541264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.541718 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.542415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.544843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.557974 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1254/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:26.562080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.572264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adae76a-71ba-4639-bc52-98bc9dca465d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.576910 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.577565 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.577845 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.578174 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] PATH_INFO: `/v3/projects/24b97d4c4f62489a95a97f7a60fc66f2/users/b18e455f3aca4befa7e64ce409993a55/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.598891 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.599229 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b97d4c4f62489a95a97f7a60fc66f2, user_id=b18e455f3aca4befa7e64ce409993a55, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.601121 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.602165 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61641756-812c-40a2-a52d-d0049134d49b admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.617468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5f4c4-c15e-4b45-bb0e-2e8aa6f061da admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.623377 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1269/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:26 2022] PUT /identity/v3/projects/24b97d4c4f62489a95a97f7a60fc66f2/users/b18e455f3aca4befa7e64ce409993a55/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:26.629843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.630136 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.630523 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.630902 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:26.661026 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] MFA Rules not processed for user `b18e455f3aca4befa7e64ce409993a55`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.662258 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.688752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.689682 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.689923 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.690196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] PATH_INFO: `/v3/projects/dd53dcafeebd4015a0ba857c03611b74` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.691652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd53dcafeebd4015a0ba857c03611b74)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.700106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.706436 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:26.731015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1270/2524] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:26.741608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.743066 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.750288 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd53dcafeebd4015a0ba857c03611b74', 'request_id': 'req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.758152 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd53dcafeebd4015a0ba857c03611b74', 'request_id': 'req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.768766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd53dcafeebd4015a0ba857c03611b74', 'request_id': 'req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.780321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] The token cache is being invalidate because project dd53dcafeebd4015a0ba857c03611b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81355) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:26.780608 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.781276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-eb1d9141-e7ab-48d3-a47b-11eb2184e09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:26.783483 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1255/2525] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:26 2022] DELETE /identity/v3/projects/dd53dcafeebd4015a0ba857c03611b74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:26.788080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65a52-e3a4-4193-83f8-b75e5eb82a92 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.788362 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65a52-e3a4-4193-83f8-b75e5eb82a92 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.788635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b65a52-e3a4-4193-83f8-b75e5eb82a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.808124 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-a2b65a52-e3a4-4193-83f8-b75e5eb82a92 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.809325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-a2b65a52-e3a4-4193-83f8-b75e5eb82a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.813172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fff08-4c72-46b8-86a9-7db0d9639bb9 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.865476 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.866178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.866484 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.866757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.868589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.873437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1256/2526] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:26.881730 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.881946 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.882220 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.902111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:26.903354 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:26.911310 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1257/2527] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:15:26.915446 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.925577 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475d03c-b833-4f18-bbc2-40f3c6b16c13 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.930491 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.931226 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.931505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.931774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.932417 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:26.932717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.934356 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.937221 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.939241 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.950667 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1258/2528] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:15:26.950858 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1271/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:26.951689 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:26.962164 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140156e-8b0c-4cc7-b4df-1d5c07087bb6 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:26.966861 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:26.967502 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:26.967784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:26.968059 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:26.968811 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:26.970746 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:26.992080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:27.000677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1259/2530] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:26 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:27.005023 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:27.019507 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa504f-6ec7-4765-9e5c-93432ccb2012 service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:27.068799 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=100 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:27.080232 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:27.081068 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.081364 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.081627 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] PATH_INFO: `/v3/users` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.082595 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:27.084184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:27.115466 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1272/2531] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:27 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:27.117174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:27.128142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be74c-57ed-42f5-8b30-004fa152a057 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:27.132894 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:27.133448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.133692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.133966 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.134677 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:27.136427 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:27.147049 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1260/2532] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:27.151096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:27.161810 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaffe8-26ea-4414-9156-442e93b11c5c admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:27.166633 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:27.167295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.167570 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.167847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.168461 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:27.170030 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6279a-307a-4865-afcb-1f02cc0d5722 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:27.182696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1273/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:15:27.187179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:27.198232 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0629e-6ba7-4cb1-afc2-19f43bf08572 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:27.203414 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:27.204834 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.205233 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.205687 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] PATH_INFO: `/v3/projects/a65db78db8fa44b6a75336e0546bfd74/users/fa6d20f3eef342d4a3d1b52c422584ad/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.221265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65db78db8fa44b6a75336e0546bfd74, user_id=fa6d20f3eef342d4a3d1b52c422584ad, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:27.224116 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:27.239111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1261/2534] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:27 2022] PUT /identity/v3/projects/a65db78db8fa44b6a75336e0546bfd74/users/fa6d20f3eef342d4a3d1b52c422584ad/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:27.244047 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c1b5-75cf-4404-8735-f9aee8ee7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.244334 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c1b5-75cf-4404-8735-f9aee8ee7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.244610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c1b5-75cf-4404-8735-f9aee8ee7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.270099 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3e86c1b5-75cf-4404-8735-f9aee8ee7ed9 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:27.271451 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3e86c1b5-75cf-4404-8735-f9aee8ee7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:27.342941 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1274/2535] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:27.352535 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:27.354204 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:27.422423 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db586-8178-4554-9d0c-bebfbadec940 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:27.426700 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:27.427378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:27.427661 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:27.427934 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:27.437088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:27.438545 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:27.448506 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1262/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:28.072420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43676fe-324e-4c16-95e9-702e212b9bc6 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:28.072954 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43676fe-324e-4c16-95e9-702e212b9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:28.073051 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43676fe-324e-4c16-95e9-702e212b9bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:28.109031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-f43676fe-324e-4c16-95e9-702e212b9bc6 None None] MFA Rules not processed for user `fa6d20f3eef342d4a3d1b52c422584ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:28.110295 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-f43676fe-324e-4c16-95e9-702e212b9bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:28.178534 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1275/2537] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:28.190190 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:28.191635 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:28.248284 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050f75-0b3e-4987-aca2-f086a5d08af1 service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:28.252448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:28.253056 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:28.253464 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:28.253734 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:28.264196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:28.265659 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:28.274961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1263/2538] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:29.681132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a0fc-b477-453c-9743-0081e147112e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:29.681663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a0fc-b477-453c-9743-0081e147112e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:29.681663 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357a0fc-b477-453c-9743-0081e147112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:29.701083 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-0357a0fc-b477-453c-9743-0081e147112e None None] MFA Rules not processed for user `fa6d20f3eef342d4a3d1b52c422584ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:29.702371 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-0357a0fc-b477-453c-9743-0081e147112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:29.710094 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1276/2539] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:30.072438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:30.074084 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:30.088560 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45f20-c2cc-4352-a24e-c34172211458 service cinder] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:30.093578 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:30.094196 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.094468 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.094739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] PATH_INFO: `/v3/users/b18e455f3aca4befa7e64ce409993a55` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:30.096839 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18e455f3aca4befa7e64ce409993a55)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:30.098826 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:30.148028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18e455f3aca4befa7e64ce409993a55'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.155760 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18e455f3aca4befa7e64ce409993a55'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.164445 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18e455f3aca4befa7e64ce409993a55'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.166615 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:30.180691 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18e455f3aca4befa7e64ce409993a55'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.181399 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18e455f3aca4befa7e64ce409993a55'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.187711 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1264/2540] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:30 2022] DELETE /identity/v3/users/b18e455f3aca4befa7e64ce409993a55 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:30.192711 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.193072 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.193417 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:30.213757 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:30.215063 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:30.274880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:30.293778 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1277/2541] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:30.295142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:30.297368 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:30.364257 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e4b4e-864f-4e94-a5df-ff9e0672e1a5 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:30.367953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:30.368552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.368827 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.369097 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:30.378970 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:30.380420 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41407447-f2d5-45a0-b728-f01bc1ffd777 service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:30.390297 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1265/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:15:30.687125 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:30.688823 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:30.702578 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a75cc0-162a-4f06-8a4b-7901c15c8a6f None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:30.707880 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:30.708610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.708957 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.709324 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] PATH_INFO: `/v3/projects/24b97d4c4f62489a95a97f7a60fc66f2` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:30.710564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b97d4c4f62489a95a97f7a60fc66f2)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:30.712621 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:30.772354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b97d4c4f62489a95a97f7a60fc66f2', 'request_id': 'req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.781608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b97d4c4f62489a95a97f7a60fc66f2', 'request_id': 'req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.790272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b97d4c4f62489a95a97f7a60fc66f2', 'request_id': 'req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.812138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] The token cache is being invalidate because project 24b97d4c4f62489a95a97f7a60fc66f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:30.812544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.813379 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-d59a8f9d-decd-4962-b63c-07e2cd4b62b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:30.815138 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1278/2543] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:30 2022] DELETE /identity/v3/projects/24b97d4c4f62489a95a97f7a60fc66f2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:30.820574 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.820860 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.821131 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:30.842170 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:30.843406 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:30.914939 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1266/2544] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:30.981892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:30.982282 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:30.982474 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.002435 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:31.003676 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:31.011800 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1279/2545] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:31.016113 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.026765 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5defb9-4e71-45c0-ae29-6f43fb2602f7 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.031791 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.033168 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.034418 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.034616 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.035211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:15:31.035516 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.037264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.053163 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1267/2546] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:15:31.054353 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.064608 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41913e1-3f77-4bdc-9d16-1a26456dc55e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.069840 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.070444 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.070719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.070995 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.071697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.073577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.103042 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1280/2547] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:15:31 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:31.107275 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.117536 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e91ea-7208-418c-8c02-2beee714a98c admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.174814 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.175455 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.175731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.176000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.176625 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.178543 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.199544 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1268/2548] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:15:31 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:15:31.203870 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.229300 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e795b-1a95-4143-b93c-79ce160db047 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.230727 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.231432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.231708 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.231977 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.232833 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.234433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.245203 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1281/2549] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:31.249229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.254549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:31.261549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a217ab-3913-4c99-934c-dd4308744a12 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.267731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.268337 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.268646 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.268917 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.269549 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.271273 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4610f39-8a43-4349-a914-c11dadb40a33 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.283428 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1269/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:15:31.287797 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.299864 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a78-8529-40ed-8cb9-dc23e6b93c54 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.304617 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.305309 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.305587 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.305863 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] PATH_INFO: `/v3/projects/2319de23de8f4f08b1751658328bc919/users/079e7f35c72544b28af5ac64289338bf/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.322944 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2319de23de8f4f08b1751658328bc919, user_id=079e7f35c72544b28af5ac64289338bf, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.325583 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.343250 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1282/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:15:31 2022] PUT /identity/v3/projects/2319de23de8f4f08b1751658328bc919/users/079e7f35c72544b28af5ac64289338bf/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:31.355605 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.356562 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.356990 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.413933 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] MFA Rules not processed for user `079e7f35c72544b28af5ac64289338bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:31.415264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:31.506478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1270/2552] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:31.534536 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:31.536629 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:31.635501 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98103ca5-1b78-45ee-a791-99e00b43511f admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:31.639692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:31.640315 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:31.641387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:31.641387 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:31.651052 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:31.652515 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:31.662310 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1283/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:32.011378 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:32.012792 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:32.189958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2560e9-86eb-4118-be4d-bc277c8d974f None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:32.197897 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:32.198843 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:32.199546 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:32.200094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:32.203415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:32.221148 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:32.223279 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:32.251724 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1271/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:37.206732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:37.208249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:37.228719 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:37.270038 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9db41-9664-4754-9c16-160d4201a6ff service cinder] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:37.273618 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:37.274218 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:37.274500 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:37.274772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:37.276496 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:37.367701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:37.369132 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd93939-eda0-4ee8-9890-0c3b62eb6bc3 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:37.379903 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1284/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:40.994613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:41.005088 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04f533-74d4-4d92-913e-8b37824d9187 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:41.009993 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:41.010620 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:41.010900 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:41.011201 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] PATH_INFO: `/v3/users/079e7f35c72544b28af5ac64289338bf` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:41.012346 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079e7f35c72544b28af5ac64289338bf)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:41.014299 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:41.062008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079e7f35c72544b28af5ac64289338bf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.069062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079e7f35c72544b28af5ac64289338bf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.072721 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:41.076715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079e7f35c72544b28af5ac64289338bf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.092333 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079e7f35c72544b28af5ac64289338bf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.093083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079e7f35c72544b28af5ac64289338bf'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.100029 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1272/2556] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:40 2022] DELETE /identity/v3/users/079e7f35c72544b28af5ac64289338bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:41.104704 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:41.105190 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:41.105418 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:41.125671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:41.127613 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:41.197654 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1285/2557] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:41.208091 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:41.219747 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:41.300561 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d2c-25fc-4592-ba2e-46bc376edf76 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:41.303707 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:41.304470 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:41.304750 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:41.305023 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:41.315269 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:41.316704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:41.326809 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1273/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:41.691215 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:41.692790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:41.708980 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ab2f0-9f77-4966-a272-6765f7e905ad None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:41.714832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:41.715665 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:41.715938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:41.716392 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] PATH_INFO: `/v3/projects/2319de23de8f4f08b1751658328bc919` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:41.717749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2319de23de8f4f08b1751658328bc919)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:41.719981 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:41.793287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2319de23de8f4f08b1751658328bc919', 'request_id': 'req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.802133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2319de23de8f4f08b1751658328bc919', 'request_id': 'req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.809464 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2319de23de8f4f08b1751658328bc919', 'request_id': 'req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.811909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:41.835358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] The token cache is being invalidate because project 2319de23de8f4f08b1751658328bc919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:41.835522 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.837032 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-57ab3fc7-a1c8-4f84-b9e0-0e1cc5ee7746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:41.838081 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1286/2559] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:41 2022] DELETE /identity/v3/projects/2319de23de8f4f08b1751658328bc919 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:43.729080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:43.731165 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:43.755176 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2d37f-4016-4368-a573-0b8810e74f2e service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:43.832779 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:43.833503 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:43.833883 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:43.834222 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] PATH_INFO: `/v3/users/93589cdeda8b40629edf0071784f86eb` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:43.835476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93589cdeda8b40629edf0071784f86eb)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:43.837439 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:43.891912 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93589cdeda8b40629edf0071784f86eb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:43.902036 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93589cdeda8b40629edf0071784f86eb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:43.910505 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93589cdeda8b40629edf0071784f86eb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:43.926565 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93589cdeda8b40629edf0071784f86eb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:43.927679 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93589cdeda8b40629edf0071784f86eb'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:43.930231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:43.939292 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1274/2560] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:43 2022] DELETE /identity/v3/users/93589cdeda8b40629edf0071784f86eb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:43.941730 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:43.942874 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:43.943260 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:43.966696 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:43.968009 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:44.044096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1287/2561] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:44.054692 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:44.056185 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:44.122525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448307-2e25-49e7-a659-27c874dec578 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:44.126321 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:44.126927 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:44.127242 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:44.127512 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:44.147302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:44.148759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:44.179166 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1275/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:44.640147 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:44.642255 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:44.658671 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ce9f-1a3c-477d-aebd-8b4346184e5e None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:44.669126 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:44.671196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:44.672271 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:44.672736 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] PATH_INFO: `/v3/projects/260a9329c3bc45bfa6127145e86749b1` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:44.676732 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260a9329c3bc45bfa6127145e86749b1)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:44.681982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:44.758177 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260a9329c3bc45bfa6127145e86749b1', 'request_id': 'req-247b3670-5627-4eb2-99b0-a09c2248bf31'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:44.765896 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260a9329c3bc45bfa6127145e86749b1', 'request_id': 'req-247b3670-5627-4eb2-99b0-a09c2248bf31'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:44.773923 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260a9329c3bc45bfa6127145e86749b1', 'request_id': 'req-247b3670-5627-4eb2-99b0-a09c2248bf31'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:44.790041 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] The token cache is being invalidate because project 260a9329c3bc45bfa6127145e86749b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:44.790344 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:44.791007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:44.792814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1288/2563] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:44 2022] DELETE /identity/v3/projects/260a9329c3bc45bfa6127145e86749b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:45.067448 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:45.068520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:45.098962 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63a1e-c2d3-455a-a39a-2497c2a26fbf service neutron] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:45.156752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:45.157415 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:45.157693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:45.157957 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] PATH_INFO: `/v3/users/e471a36a66f54520ae2b4b2548e1d315` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:45.159095 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e471a36a66f54520ae2b4b2548e1d315)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:45.161015 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:45.209960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e471a36a66f54520ae2b4b2548e1d315'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.217910 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e471a36a66f54520ae2b4b2548e1d315'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.226585 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e471a36a66f54520ae2b4b2548e1d315'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.239952 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e471a36a66f54520ae2b4b2548e1d315'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.240660 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e471a36a66f54520ae2b4b2548e1d315'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.250335 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1276/2564] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:45 2022] DELETE /identity/v3/users/e471a36a66f54520ae2b4b2548e1d315 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:45.421013 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:45.422557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:45.436200 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b3670-5627-4eb2-99b0-a09c2248bf31 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:45.495098 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:45.495830 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:45.496114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:45.496385 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] PATH_INFO: `/v3/projects/58a9386d32784072aa1aa00715ad3eae` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:45.497499 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a9386d32784072aa1aa00715ad3eae)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:45.499563 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:45.520849 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:45.553598 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a9386d32784072aa1aa00715ad3eae', 'request_id': 'req-12d31a69-8a95-40d6-9faf-122053a3dab0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.560173 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a9386d32784072aa1aa00715ad3eae', 'request_id': 'req-12d31a69-8a95-40d6-9faf-122053a3dab0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.567080 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a9386d32784072aa1aa00715ad3eae', 'request_id': 'req-12d31a69-8a95-40d6-9faf-122053a3dab0'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.580989 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] The token cache is being invalidate because project 58a9386d32784072aa1aa00715ad3eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:45.581345 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.582166 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.584183 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1289/2565] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:45 2022] DELETE /identity/v3/projects/58a9386d32784072aa1aa00715ad3eae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:45.587924 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:45.589303 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:45.602507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d9e69-837c-4fbc-8cc3-2577b7a702a2 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:45.621054 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:45.661294 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:45.661930 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:45.662211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:45.662486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] PATH_INFO: `/v3/users/1f375d18e2e34917972adec65b5a24c4` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:45.663727 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f375d18e2e34917972adec65b5a24c4)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:45.665784 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:45.711472 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f375d18e2e34917972adec65b5a24c4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.718254 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f375d18e2e34917972adec65b5a24c4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.725782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f375d18e2e34917972adec65b5a24c4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.737953 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f375d18e2e34917972adec65b5a24c4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.738575 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-a6ade4fb-3ee8-4a42-8933-0ff996517380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f375d18e2e34917972adec65b5a24c4'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:45.744302 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1277/2566] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:15:45 2022] DELETE /identity/v3/users/1f375d18e2e34917972adec65b5a24c4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:15:45.911885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:45.913311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:45.929755 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31a69-8a95-40d6-9faf-122053a3dab0 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:45.987178 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:45.987815 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:45.988096 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:45.988421 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] PATH_INFO: `/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:45.989553 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df3c1d6206f40a1b2c1e155d7c3703c)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:45.991477 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:46.037031 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df3c1d6206f40a1b2c1e155d7c3703c', 'request_id': 'req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:46.042393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df3c1d6206f40a1b2c1e155d7c3703c', 'request_id': 'req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:46.048714 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df3c1d6206f40a1b2c1e155d7c3703c', 'request_id': 'req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:46.061006 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] The token cache is being invalidate because project 1df3c1d6206f40a1b2c1e155d7c3703c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:15:46.061294 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:46.061913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:15:46.063422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1290/2567] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:15:45 2022] DELETE /identity/v3/projects/1df3c1d6206f40a1b2c1e155d7c3703c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:15:48.605432 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d58f2-7030-4272-b39c-a62c76b35e5d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:48.605929 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d58f2-7030-4272-b39c-a62c76b35e5d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:48.606039 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d58f2-7030-4272-b39c-a62c76b35e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:48.625276 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-033d58f2-7030-4272-b39c-a62c76b35e5d None None] MFA Rules not processed for user `fa6d20f3eef342d4a3d1b52c422584ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:15:48.626941 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-033d58f2-7030-4272-b39c-a62c76b35e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:48.681212 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1278/2568] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:15:48.910432 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:15:48.911881 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:48.951393 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:48.971742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf8442-fb34-4e3d-8083-a7cf29f7a9de admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:15:48.975302 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:15:48.975899 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:15:48.976172 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:15:48.976441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:15:48.978112 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:15:48.987902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:15:48.989280 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:15:48.997001 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1291/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:15:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:15:58.674603 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=68,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:15:58.993449 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=10 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:04.368498 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:04.368983 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:04.369080 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:04.407963 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:04.409162 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:04.488300 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1279/2570] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Oct 23 00:16:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:04.536240 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:04.537701 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:04.651802 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3023c-1049-4e71-bfdb-06ac9178961c service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:04.656745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:04.657366 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:04.657636 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:04.657902 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:04.665745 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:04.667340 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb8914-a9c8-4da2-bd4c-d10a9eb1c16f service swift] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:04.675564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1292/2571] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:16:10.968507 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:10.970510 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:11.089976 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f96401-325f-4076-8278-849cb3f142e6 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:11.095959 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:11.096587 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:11.096863 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:11.097141 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:11.098958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:11.119038 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:11.121552 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:11.134954 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1280/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:14.672965 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=54 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:20.016958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:20.017544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:20.017544 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:20.036960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] MFA Rules not processed for user `b117c6096699423e861914df7f150e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:20.038131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:20.045383 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1293/2573] 10.222.0.20 () {58 vars in 967 bytes} [Sun Oct 23 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:20.058101 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:20.069271 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22147bcf-55b4-4146-8f4c-d2450483753f service placement] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:20.074179 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '318a76b9d85747f5ae83df6d6b497131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:20.074766 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:20.075044 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:20.075353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:20.083156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:20.084715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:20.092590 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1281/2574] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Oct 23 00:16:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:16:21.913029 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:21.925742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7316f-4272-4483-83a4-ec309d4ca332 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:21.930713 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:21.931347 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:21.931620 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:21.931884 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:21.933577 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:21.945641 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:21.947829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:21.958876 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1294/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:21.970358 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:21.971960 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:22.000830 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=100 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:22.079312 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51756c4-5f5d-4faf-834b-c9cb44dd7529 service swift] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.083855 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.084476 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.084755 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.085024 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] PATH_INFO: `/v3/users/fa6d20f3eef342d4a3d1b52c422584ad` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.086142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6d20f3eef342d4a3d1b52c422584ad)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.088078 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.133756 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6d20f3eef342d4a3d1b52c422584ad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.140613 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6d20f3eef342d4a3d1b52c422584ad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.148083 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6d20f3eef342d4a3d1b52c422584ad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.159845 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6d20f3eef342d4a3d1b52c422584ad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.160520 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-ae320ec3-1532-4d27-b622-b560d71f6f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6d20f3eef342d4a3d1b52c422584ad'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.166367 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1282/2576] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:16:21 2022] DELETE /identity/v3/users/fa6d20f3eef342d4a3d1b52c422584ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:16:22.335339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.346405 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d039b5-7642-44c8-a19c-e868da35cf93 service placement] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.403535 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.404157 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.404431 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.404700 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] PATH_INFO: `/v3/projects/a65db78db8fa44b6a75336e0546bfd74` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.405790 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65db78db8fa44b6a75336e0546bfd74)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.407726 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.452964 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65db78db8fa44b6a75336e0546bfd74', 'request_id': 'req-ac5243bc-c940-4478-9ddf-e1d107ae35b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.458342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65db78db8fa44b6a75336e0546bfd74', 'request_id': 'req-ac5243bc-c940-4478-9ddf-e1d107ae35b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.464458 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65db78db8fa44b6a75336e0546bfd74', 'request_id': 'req-ac5243bc-c940-4478-9ddf-e1d107ae35b1'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.476090 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] The token cache is being invalidate because project a65db78db8fa44b6a75336e0546bfd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:16:22.476376 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.476984 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-ac5243bc-c940-4478-9ddf-e1d107ae35b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:16:22.478419 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1295/2577] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:16:22 2022] DELETE /identity/v3/projects/a65db78db8fa44b6a75336e0546bfd74 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:16:22.483486 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.483775 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.484050 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.541926 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:22.543209 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:22.576487 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:22.604327 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1283/2578] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:22.612558 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.612838 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.613108 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.632933 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:22.634117 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:22.642045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1296/2579] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:22.646195 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.655626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb733bd-0ab6-44d2-8be8-3e08346dfe17 None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.660174 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.660789 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.661062 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.661330 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.661964 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81355) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:16:22.662265 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.663873 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.676383 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1284/2580] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Oct 23 00:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:16:22.680564 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.690074 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbf255-424d-472e-a6ac-b369758a2c6b None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.694697 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.695311 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.695589 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.695860 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] PATH_INFO: `/v3/projects` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.696491 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.698358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.724931 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1297/2581] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Oct 23 00:16:22 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:16:22.729085 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.739430 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587d82-1dd2-45aa-a7a3-ef99b3161ce5 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.793626 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.794211 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.794484 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.794752 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] PATH_INFO: `/v3/users` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.795642 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.798186 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.818988 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1285/2582] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Oct 23 00:16:22 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:16:22.822422 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.832635 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e953-1cb1-49a0-b23b-d4948b50c50d admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.837161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.837749 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.838028 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.838304 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.838938 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.840545 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.851211 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1298/2583] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:16:22.854961 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.865478 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b92fa-6e37-409e-a003-40a777be70fe admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.870106 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.870698 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.870979 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.871289 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.871925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.873504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd225d-e4b1-41ec-9f27-f21ca97a5a24 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.884003 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1286/2584] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Oct 23 00:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:16:22.887892 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:22.897691 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b618c37-703e-4a1d-aaa9-0b704f9e4809 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:22.902288 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:22.902928 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.903248 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.903528 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] PATH_INFO: `/v3/projects/47eb9c544cfb4bd0b31f97797467649e/users/2079aa7dc1f14a74a0767b972b9047d2/roles/38335e20ab1a4ff9976fcfd55484637f` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.918328 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eb9c544cfb4bd0b31f97797467649e, user_id=2079aa7dc1f14a74a0767b972b9047d2, role_id=38335e20ab1a4ff9976fcfd55484637f)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:22.921264 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:22.934158 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1299/2585] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Oct 23 00:16:22 2022] PUT /identity/v3/projects/47eb9c544cfb4bd0b31f97797467649e/users/2079aa7dc1f14a74a0767b972b9047d2/roles/38335e20ab1a4ff9976fcfd55484637f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:16:22.939045 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d421d6-0139-45fe-abe3-c5e67a36f1c4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:22.939363 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d421d6-0139-45fe-abe3-c5e67a36f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:22.939641 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d421d6-0139-45fe-abe3-c5e67a36f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:22.958094 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-32d421d6-0139-45fe-abe3-c5e67a36f1c4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:22.959324 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-32d421d6-0139-45fe-abe3-c5e67a36f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:23.017364 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1287/2586] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:23.027139 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:23.028827 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:23.038909 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:23.107269 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487cdab-9711-4b67-85ff-ed9fb7506485 admin admin] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:23.111342 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1686221d7f4fdd942d96423204b366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:23.111935 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:23.112210 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:23.112479 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:23.121133 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:23.122530 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:23.132272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1300/2587] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:16:23.739958 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76d1e-ed31-4fc6-a614-b74b80a32301 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:23.740249 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76d1e-ed31-4fc6-a614-b74b80a32301 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:23.740525 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f76d1e-ed31-4fc6-a614-b74b80a32301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:23.771035 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-10f76d1e-ed31-4fc6-a614-b74b80a32301 None None] MFA Rules not processed for user `2079aa7dc1f14a74a0767b972b9047d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:23.772278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-10f76d1e-ed31-4fc6-a614-b74b80a32301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:23.806731 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:23.839717 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1288/2588] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:16:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:23.850925 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:23.852382 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:23.910296 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77da8c-2e63-47dc-81ea-e2e9e7367f03 service neutron] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:23.913814 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587f9cc7c6714a718e19a10d1d6b6385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:23.914410 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:23.914692 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:23.914967 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:23.923685 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:23.925114 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697305f-8618-4ca1-95bb-d87cc3d0c6b1 service cinder] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:23.933885 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1301/2589] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:25.291569 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:25.292111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:25.292248 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:25.311231 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] MFA Rules not processed for user `2079aa7dc1f14a74a0767b972b9047d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:25.312425 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:25.319723 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1289/2590] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:33.930045 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=58 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:35.306100 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=15 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:16:50.378675 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d6e1-7bf4-40c8-9669-ca11dd7463fa None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:50.379261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d6e1-7bf4-40c8-9669-ca11dd7463fa None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:50.379261 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d6e1-7bf4-40c8-9669-ca11dd7463fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:50.399906 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-3fc9d6e1-7bf4-40c8-9669-ca11dd7463fa None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:50.401105 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-3fc9d6e1-7bf4-40c8-9669-ca11dd7463fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:50.409441 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1302/2591] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:50.425534 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:50.426935 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:50.521334 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5f8b1-de75-4973-861e-949ecd74767d None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:50.527490 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:50.527644 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:50.527800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:50.528069 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:50.536652 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:50.538283 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:50.548008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1290/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:53.445772 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c83be-1a3a-4c7c-bf49-9d8b6c4fffd0 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:53.446299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c83be-1a3a-4c7c-bf49-9d8b6c4fffd0 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:53.446299 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c83be-1a3a-4c7c-bf49-9d8b6c4fffd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:53.465973 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-899c83be-1a3a-4c7c-bf49-9d8b6c4fffd0 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:53.467196 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-899c83be-1a3a-4c7c-bf49-9d8b6c4fffd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:53.474847 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1303/2593] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:53.492219 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:53.493622 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:53.508693 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390ffeb-01b1-4c54-8ac1-efea1d492105 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:53.514128 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:53.514715 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:53.515000 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:53.515325 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:53.524453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:53.526042 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:53.535763 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1291/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:56.703531 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ef9e-59c3-4d54-8c54-14f6eb2d4e06 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:56.704077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ef9e-59c3-4d54-8c54-14f6eb2d4e06 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:56.704077 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ef9e-59c3-4d54-8c54-14f6eb2d4e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:56.723423 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-1c01ef9e-59c3-4d54-8c54-14f6eb2d4e06 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:56.724543 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-1c01ef9e-59c3-4d54-8c54-14f6eb2d4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:56.732161 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1304/2595] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:56.747442 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:56.758729 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f74f6-1442-4a66-9967-f01ff3395897 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:56.764126 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:56.764735 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:56.765008 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:56.765278 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:56.773345 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:56.774895 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:56.785012 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1292/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:16:59.791619 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412222-55d0-4879-83ce-7ccbbbeac7c3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:59.792131 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412222-55d0-4879-83ce-7ccbbbeac7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:59.792249 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412222-55d0-4879-83ce-7ccbbbeac7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:59.812088 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-61412222-55d0-4879-83ce-7ccbbbeac7c3 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:16:59.813843 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-61412222-55d0-4879-83ce-7ccbbbeac7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:16:59.821493 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1305/2597] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:16:59.836443 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:16:59.847459 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfee97-3c23-47e7-85ad-115ad974ea68 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:16:59.852856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:16:59.853437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:16:59.853708 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:16:59.853977 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:16:59.862437 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:16:59.864011 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:16:59.873110 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1293/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:02.945817 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf1c8-a5d2-431c-9040-bf47ea79f107 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:02.946313 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf1c8-a5d2-431c-9040-bf47ea79f107 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:02.946424 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf1c8-a5d2-431c-9040-bf47ea79f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:02.965319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-357cf1c8-a5d2-431c-9040-bf47ea79f107 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:02.966489 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-357cf1c8-a5d2-431c-9040-bf47ea79f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:02.974263 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1306/2599] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:03.003822 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:03.014774 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04963f-7357-473b-bae4-7e96aca8f172 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:03.020480 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:03.021077 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:03.021352 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:03.021647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:03.029807 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:03.031398 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:03.040782 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1294/2600] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:06.113151 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc349-9922-4f9f-a9f1-eae686f367ab None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:06.113632 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc349-9922-4f9f-a9f1-eae686f367ab None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:06.113742 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc349-9922-4f9f-a9f1-eae686f367ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:06.132610 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-801fc349-9922-4f9f-a9f1-eae686f367ab None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:06.133781 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-801fc349-9922-4f9f-a9f1-eae686f367ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:06.142015 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1307/2601] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:06.159272 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:06.170473 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06d763-b98e-493c-b7f6-3fb85551dcc3 service nova] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:06.175876 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:06.176461 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:06.176736 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:06.177006 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:06.184816 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:06.186353 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74f0e3-c244-4d57-8831-3b359523fb14 service nova] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:06.196264 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1295/2602] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:16.128352 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=18 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:16.192156 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=73 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:21.226689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] REQUEST_METHOD: `POST` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:21.227238 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:21.227339 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:21.245809 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.auth.core [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] MFA Rules not processed for user `2079aa7dc1f14a74a0767b972b9047d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:21.247007 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.fernet_utils [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:21.254388 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1308/2603] 10.222.0.20 () {58 vars in 958 bytes} [Sun Oct 23 00:17:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:31.241084 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=3 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:31.984991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f9501-f30e-48e0-bf57-3ad4b3755d55 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:31.985504 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f9501-f30e-48e0-bf57-3ad4b3755d55 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:31.985629 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f9501-f30e-48e0-bf57-3ad4b3755d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:32.004859 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-728f9501-f30e-48e0-bf57-3ad4b3755d55 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:32.005999 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-728f9501-f30e-48e0-bf57-3ad4b3755d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:32.013703 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1296/2604] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:32.028920 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:32.042222 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d624e62-98d7-4504-a91e-fac73498a1f3 None None] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:32.047829 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:32.048413 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:32.048689 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:32.048960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:32.056873 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:32.058426 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:32.067765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1309/2605] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:35.226419 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26e3d-573a-4f22-96cd-0cd8fbac0219 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:35.226995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26e3d-573a-4f22-96cd-0cd8fbac0219 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:35.226995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26e3d-573a-4f22-96cd-0cd8fbac0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:35.245739 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-40d26e3d-573a-4f22-96cd-0cd8fbac0219 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:35.246925 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-40d26e3d-573a-4f22-96cd-0cd8fbac0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:35.254647 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1297/2606] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:35.272582 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:35.283674 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62989f48-a228-4a15-b465-704d313b4ca3 service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:35.289658 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:35.290354 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:35.290640 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:35.290913 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:35.299908 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:35.301482 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:35.310894 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1310/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:38.317482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61638-bf45-4abe-9ec5-d6b628505cb4 None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:38.317985 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61638-bf45-4abe-9ec5-d6b628505cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:38.318178 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61638-bf45-4abe-9ec5-d6b628505cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:38.337268 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-ded61638-bf45-4abe-9ec5-d6b628505cb4 None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:38.338453 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-ded61638-bf45-4abe-9ec5-d6b628505cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:38.346197 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1298/2608] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:38.361433 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:38.373319 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad8ea2-d557-4cd4-863f-08b32e05a878 service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:38.378786 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:38.379408 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:38.379687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:38.379960 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:38.387958 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:38.389510 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:38.398792 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1311/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:41.512400 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c58-6c9f-45bd-928e-b5d709ddfccd None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:41.512880 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c58-6c9f-45bd-928e-b5d709ddfccd None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:41.512995 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c58-6c9f-45bd-928e-b5d709ddfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:41.532913 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-01032c58-6c9f-45bd-928e-b5d709ddfccd None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:41.534125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-01032c58-6c9f-45bd-928e-b5d709ddfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:41.542482 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1299/2610] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:41.560895 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:41.572272 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f247-b377-4dfd-ada6-e30dbfbb9bd6 service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:41.577687 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:41.578274 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:41.578552 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:41.578825 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:41.586683 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:41.588287 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:41.597832 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1312/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:44.662436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221446-681c-41fd-943d-bc684095d6fc None None] REQUEST_METHOD: `POST` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:44.662950 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221446-681c-41fd-943d-bc684095d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:44.663111 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221446-681c-41fd-943d-bc684095d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:44.682748 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.auth.core [None req-67221446-681c-41fd-943d-bc684095d6fc None None] MFA Rules not processed for user `b9d16ca4ea714ae1a819840d96e40696`. Rule list: `[]` (Enabled: `True`). {{(pid=81355) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:17:44.683987 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-67221446-681c-41fd-943d-bc684095d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:17:44.691666 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1300/2612] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Oct 23 00:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:17:44.707401 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:17:44.718454 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c212-4adf-4dcd-a799-e99ffa230e7e service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:17:44.723970 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aba6d76ac940dcaa33247c65cc57b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:17:44.724557 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] REQUEST_METHOD: `GET` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:17:44.724836 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:17:44.725107 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:17:44.733089 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:17:44.734673 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:17:44.744526 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1313/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:17:54.677051 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=15 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:17:54.739765 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=30 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:12.512744 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67221446-681c-41fd-943d-bc684095d6fc None None] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:18:12.523028 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67221446-681c-41fd-943d-bc684095d6fc None None] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:18:12.529407 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:18:12.530229 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:18:12.530436 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:18:12.530704 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] PATH_INFO: `/v3/users/2079aa7dc1f14a74a0767b972b9047d2` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:18:12.531856 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2079aa7dc1f14a74a0767b972b9047d2)` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:18:12.533759 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:18:12.579898 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2079aa7dc1f14a74a0767b972b9047d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.586778 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2079aa7dc1f14a74a0767b972b9047d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.594120 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2079aa7dc1f14a74a0767b972b9047d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.605991 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2079aa7dc1f14a74a0767b972b9047d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.607184 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.notifications [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2079aa7dc1f14a74a0767b972b9047d2'} {{(pid=81355) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.612949 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1301/2614] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Oct 23 00:18:12 2022] DELETE /identity/v3/users/2079aa7dc1f14a74a0767b972b9047d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:18:12.782741 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] Authenticating user token {{(pid=81356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:18:12.795184 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1900-79c4-4f5b-ac5d-9a6727e56d10 service nova] Validating token access rules against request {{(pid=81356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:18:12.854101 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9d16ca4ea714ae1a819840d96e40696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3ab34f677c3438798ed2f88102aad11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:18:12.854669 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:18:12.854982 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:18:12.855320 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] PATH_INFO: `/v3/projects/47eb9c544cfb4bd0b31f97797467649e` {{(pid=81356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:18:12.856469 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eb9c544cfb4bd0b31f97797467649e)` {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:18:12.858358 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] RBAC: Authorization granted {{(pid=81356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:18:12.903008 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eb9c544cfb4bd0b31f97797467649e', 'request_id': 'req-1463074a-1f26-4cd4-bad3-f76b735c4440'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.909346 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eb9c544cfb4bd0b31f97797467649e', 'request_id': 'req-1463074a-1f26-4cd4-bad3-f76b735c4440'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.916234 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eb9c544cfb4bd0b31f97797467649e', 'request_id': 'req-1463074a-1f26-4cd4-bad3-f76b735c4440'} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.931141 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] The token cache is being invalidate because project 47eb9c544cfb4bd0b31f97797467649e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:18:12.931509 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.932143 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG keystone.notifications [None req-1463074a-1f26-4cd4-bad3-f76b735c4440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:18:12.933624 dv-cinder-861566-5-smb devstack@keystone.service[81356]: [pid: 81356|app: 0|req: 1314/2615] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Oct 23 00:18:12 2022] DELETE /identity/v3/projects/47eb9c544cfb4bd0b31f97797467649e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:18:22.609515 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:18:22.927420 dv-cinder-861566-5-smb devstack@keystone.service[81356]: DEBUG dbcounter [-] [81356] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:21:14.947115 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Authenticating user token {{(pid=81355) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:21:14.948522 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:21:15.018438 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235a4e-5839-49fd-aa2f-5e22c9d10213 admin admin] Validating token access rules against request {{(pid=81355) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:21:15.082104 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f066868b0a2c422590c58d763734380f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80505c9a36a4dee9330754fb31d81b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81355) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:21:15.082835 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] REQUEST_METHOD: `GET` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:21:15.083142 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] SCRIPT_NAME: `/identity` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:21:15.083413 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81355) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:21:15.085125 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.fernet_utils [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81355) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:21:15.096663 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:21:15.098800 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1b9a-87f6-4585-97bc-91ea079c7de8 service placement] RBAC: Authorization granted {{(pid=81355) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:21:15.109228 dv-cinder-861566-5-smb devstack@keystone.service[81355]: [pid: 81355|app: 0|req: 1302/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Oct 23 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:21:25.104500 dv-cinder-861566-5-smb devstack@keystone.service[81355]: DEBUG dbcounter [-] [81355] Writing DB stats keystone:SELECT=58 {{(pid=81355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}